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® DOT CODE AND INFORMATION tiEOORDlNG/R£PRODUClNG SYSTEM FOR 
RECOfiDING/REPRODUClNG DOT CODfe 


© A long time optical recording and repeated re- 
production of multimedia information is possible. Us- 
ing a printer system or printing process system, on a 
recording medium such as a sHeet, the so-caled 
multimedia information in the forth of dot Cbdes (36) 
together with images (32) and characters (34) is 
recorded. The multimedia Information includes audio 


information such as voices, image information ob- 
tainable from a camera and others, and digitally 
coded data obtainable from a personal computer and 
others. A pen-Jike information reproducing device 
(40) is manually moved to scah the dot codes (36) 
and to take in the dot codes. The original sound is 
generated by a voice output device (42) such as an 
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earphone, the original image information is outputted original data to a page printer or the like, 
on a display such as a CRT, and the digitally coded 
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[Technical Field] 

The present invention relates to a dot code 
suitable for recording and/or reproducing so-called 
multimedia information including, e.g.. audio infor- 
mation such as speech and music information, 
video information obtained by a camera, a video 
ta^e recorder, and the like, and digital code data 
obtained from a personal computer, a wordpropes- 
sof, arid the like and an ihforinhatiori record- 
ing/reproducing system for recording/reproducing 
the dot code and, more particularly, to recording 
and/or reproduction of the dot code, which can be 
optically read, on/from paper, various types of resin 
films, metal sheets, and the like. 

[Background Art] 

As media for recording speech information, 
music information, and the like; a magnetic tape, 
an optical disk, and the like are known. 

Even if, however, copies of these media are 
produced in large quarltrtiei, the unit cost of pro- 
duction is relatively hifcjh. and storage of such 
copies requires a large space. 

In addition, When a medium on which speech 
information is recorded needs to be transferred to a 
person in a remote place, it fakes rhuth labor and 
time to mail or directly tafce the medium to the 
person. 

Under the circumstances, attempts have tifeen 
made to record speech Information -oft A pS£6r 
sheet in the form of tfn€$je fhfdfni^tjon which <&fi 
be transmitted in facsimile and ailcJws pffatfiS&oh of 
copies in large quantities. As diSctoSed fh, for ex- 
ample, Jph. Pat Applh. KOKAI F*Ublicatioh Mo. 60*- 
244145, an apparatus of converting speech infor- 
mation Into image information by converting sojne 
speech information into an opficil code, arid allow- 
ing ft to b9 transmitted In facsimile hSfe been pro- 
posed. 

In the apparatus disclosed In the above official 
gazette, a sensor for reading speech information 
recorded as information which can be optically 
read Is arranged in a facsimile apparatus so Wat 
speech can be reproduced in acfcordance with an 
output from the sensor. Therefore, sfSSSdi incarna- 
tion transmitted in facsimile, which can 68 opfib^Ily 
read, can only be heaird at a Mhte toe 

facsimile apparatus is irista1l£d. Th^t is, it is rfbt 
assumed that a facsimile output sheet is tak§n to 
another place to reproddfce sounds. 

For this reason, If the refebrding capacity for 
speech information is set to be IM/ge r facsimile 
tranSsmis^ion/r^ce^tion of irifgrmfllon <Sffer than 
speech information may tie adversefy lh 
addition, H the cbfifeftfs of (h^mfflflSS re- 

cord afe difficult ehdSf&ocfa, the frtst part of the 


speech may be forgotten in the process of re- 
producing speeoh (rifomrvation in large quantities. 
Furthermore, the e&3& apjfcmtus can only trans- 
mit speech of e dlp^UOh of only a few seconds 

s bec&use the reporcfiHg capacity is limited by the 
recSrding aha a compr^s^bfi ifhethod. 

Therefore, a naag/tetie tape, an opfifcal dtsfc, or the 
lil&te rh^is^i(^|^f tretftsmlftiftg a UrrQa amount 
of speech infOnmej\pri. 

10 Sinfce tfife i^^i3Ucirig apparatus itself is Incor- 

porated in a faciilrrtil© apparatus, it is troublesome 
to perform teftetiUvfe teproabcticm of speech In- 
formation even dicing a short dur&ioh. M6r£bVer t 
an irtexpenisivd, larga-c#acity record- 

75 ing/reproctoisihg py&Sto for dl the aowsatted mul- 
timedia Infom^attoh, whfch mfeiudes mot blfy- audio 
ihforhnation but also. ^dOb information ob- 
tained by a earner^; & Vtd^o tape recorder, and the 
like, digital cotf^ daa o^fainSd from a personal 

20 computer, -&~wb^$&s&f, and the Fike, has hot 
yet been realized. 

[Distiosure ot inv^rilibh] 

26 The present invention has been rhade in con- 
sideration of thtJ a©bve point;^'nd has as Us object 
td ^rttftte : -> -dot iasSe alfiSW^ inexpensive, large- 
cavity recording and -r£^3iiftfe rdproduttion of 
multimedia infohfi^tidh IhClt&tRf g fitudio fnfdrttiation, 

30 vid^b ititifirfemu cod& data, dnd the Uke. 

arfB aft Infoto^imi retordirt^^'rodudng syste T m 
for 1 ^cordirig^p/odufeiftg <fie dot code. 

lh ord6? to m effiife otafect, an in- 

forrftatibfi reeording ^SEbm According to the 

35 pre^m invdfttten chafac®rr£fed by comprising 
input rtfeans m i^mm ^#&ffia information 
including at least (Me <8 aadto infdimatidn, video 
irtfdftnatipn. aiatt d^f&t <&de d*ffi&; conversion 
means fdr convSitlftg multimedia iriformstftm mput 

40 by the iBpyt meahs into a dot cede wWett can be 
optically rdad, «nd r&Srding mfeans for recording 
the dot <sbtte otmvert^J by the conversion means 
oh a V^ot^n^ nledJufl> such tiiat tile dot code can 
be optica]^ ^§ad> 

45 A <jbir o^^tebWing to the preset invention 
ts charactafl&d by c^pri^ihg it t»1ura(i^ Of tllbbks, 
dacH of ffi& teHi% £ data ^Sttern 

obtained' by dr^gtftg a otyrality a'ote in ^jfeor- 
dahce wi(h c^t^ls of data, a manVfer having a 

so pattern which d&ffibt be identic^ to the data dot 
pSttern and drran^ed to have a first pr^deBrmin^d 
positidnii reipaftshtp with respect to the data dot 
patibrh; a tt6tfk ad3h3& &mt\ indicating an ad- 
dress df the bIocJ< 6h%n^§a to have a isetond 

6$ pt&mmtowf &ffiw# r6tattdrrT^'hlt» with respect 
to the iharidSh ahff &H error ddt&&dft code patt6Vn 
arranged for the tfdSk addfS^s to hkve a third 
predetermined positional relationship with respect 
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to the block address pattern. 

An information reproducing system according 
to the present invention is characterized by com- 
prising read means for optically reading a dot code 
from a recording medium having a portion on 
which multimedia information including at least one 
of audio information, video information, and digital 
code data is recorded as the dot code which can 
be optically read, restoring means for converting 
the dot code read by the read means into the 
original multimedia information, and output means 
for outputting the multimedia information restored 
by the restoring means. 

In this case, the restoring means includes first 
memory means for storing the dot code read by 
the read means, marker detecting means for de- 
tecting a marker of each block from the dot code 
stored in the first memory means, data array direc- 
tion detecting means for detecting a data array 
direction from the marker of each block which is 
detected by the marker detecting means, first ad- 
dress control means for causing the first memory 
means to output the stored dot code in accordance 
with the data array direction detected by the data 
array, detecting .m^ans, demodulation means for 
demodulating the dot code output from the first 
memory means upon binarization, block address 
detecting means for detecting the block addresses 
from the .demodulated output data from the de- 
modulation means, second address control means 
for mapping the demodulated output data from the 
demodulation means in the second memory means 
in. accordance with the block addresses detected 
by the block address detecting means, and data 
output means for outputting the demodulated out- 
put data mapped in the second memory means. 

Alternatively, the restoring means includes first 
memory means for storing the dot code read by 
the read means, marker detecting means for de- 
tecting a marker of each block from the dot code 
stored in the first memory means, data array direc- 
tion detecting means for detecting a data array 
direction from the marker of each block which is 
detected by the marker detecting means, block 
address detecting means for detecting the block 
addresses in accordance with the data array direc- 
tion detected by the data array direction detecting 
means, demodulation means for demodulating the 
dot code output from the first memory means upon 
binarization, address control means for mapping 
the demodulated output data from the demodula- 
tion means in second memory means in accor- 
dance with the block addresses detected by the 
block address detecting means, and data output 
means for outputting the demodulated output data 
output from the demodulation means and mapped 
in the second memory means. 


That is, according to the information recording 
system of the present invention, multimedia in- 
formation including at least one of audio informa- 
tion, video information, and digital code data input 
5 through the input means is converted, by the con- 
version means, into a code which can be optically 
read, and the code is recorded on a recording 
medium by the recording means so as to be opti- 
cally read. 

w In this case, the dot code is obtained by ar- 

ranging the plurality of blocks, and each block 
includes the data dot pattern obtained by arranging 
the plurality of dots in accordance with the contents 
of data, the marker having the pattern which cannot 
is be identical to the data dot pattern and arranged to 
have the first predetermined positional relationship 
with respect to the data dot pattern, the block 
address pattern indicating the address of the block 
arranged to have the second predetermined posi- 

20 tional relationship with respect to the marker, and 
the error detection code pattern arranged for the 
block address to have the third predetermined po- 
sitional relationship with respect to the block ad- 
dress pattern. Therefore, the array direction of the 

25 data, i.e., a rotation and an inclination, can be 
detected by connecting the markers of the respec- 
tive blocks, and correction corresponding to the 
detection can be easily performed. 

In addition, according to the information re- 

$o producing system of the present invention, the read 
means optically reads the dot code from the re- 
cording medium having the portion on which the 
multimedia information including at least one of 
audio information, video information, and digital 

35 code data is recorded as the dot code which can 
be optically read, the restoring means converts the 
read dot code into the original multimedia informa- 
tion, and the output means outputs the restored 
multimedia information. 

40 In this case, the restoring means stores the dot 

code, read by the read means, in the first memory 
means, detects, by the marker detecting means, 
the marker of each block from the stored dot code, 
detects, by the data array direction detecting 

45 means, the data array direction from the detected 
marker of each block, and outputs, by the first 
address control means, the dot code stored in the 
first memory in accordance with the detected data 
array direction. The restoring means then demodu- 

50 lates, by the demodulation means, the dot code 
output from the first memory means upon binariza- 
tion, detects, by the block address detecting 
means, the block addresses from the demodulated 
output data, and maps, by the second address 

55 control means, the demodulated output data from 
the demodulation means in the second memory 
means in accordance with the detected block ad- 
dresses. Thereafter, the restoring means outputs, 
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by the data output means, the demodulated output 
data mapped In the second memory means. 

Alternatively, the restoring means stores the 
dot code, read by the read rhe&ns, In the first 
memory means, detects, by the marker detecting 
means, the marker of each block from the stored 
dot code, and detects, by the data array direction 
detecting m&Sns, the data array direction from the 
detected marker of each block. The restoring 
means then detects, by the block address detect- 
ing rhearis, the block addresses in accordance with 
the data array direction detected by the data array 
direction detecting means. Meanwhile, the restoring 
means demodulates, by the demodulation means, 
the dot code output from the first memory means 
upon binarteation, and maps, by the address 66n- 
trof means, the demodulated output da£ from the 
demodulation means in second memory moans in 
accordance with the block addresses detected by 
th6 block address detecting means. Thereafter, the 
restoring means outputs, by the output means, the 
demodulated data output frdrn file demodulation 
means and mapped in the second memory means. 

[Brief Description of Drawings] 

FIG. 1 is a block diagram showing the arrange* 
ment of a recording apparatus for audio inforfna- 
tion as a dot code In the fi^st embodiment of the 
present invention; 

RG. 2A is £ vfew showing the recording format 
of a dot code, arid FIG. 28 & a view showing an 
operated state of a Reproducing apparatus ac- 
cording to the first embodiment; 
RG. 3 is a block diagram shbwing the arrange- 
ment of the reproducing apfiar&us according to 
the first embodintent; 

RGS. 4A and 48 Are views for explaining man- 
ual scanning operations, respectively, and RGS. 
4C and 4D are views for explaihihg scan conver- 
sion, respectively; 

FIG. 5 is a view for explaining data interpolation 
accompanying scan conversion; 
FIG. 6 is a vlevV for explaining data array adjust- 
ment; 

RGS. 7A and 7B are views respectively showing 
recording media; 

FIG. 8 Is & vi&fr showing the arrangement of a 
reproducing appaVa^us according to the second 
embodiment; 

FIG. 9 is a view showing the arrangement of a 
reproducing apparatus according to the third 
embodiment; 

FIGS. 10A and 10B are perspective views, each 
showing an outer appearance of a ptttabte voice 
recorder; 

FIG. 11 Is a view showing the circuit arrange- 
ment of the portable voice recorder; 


FIGS. 12A and 12B are views, each showing an 
example of information printed on a recording 
medium; 

FIG. 13 is a flow chart showing dot code printing 
s processing in the volbe recorder in FIG. 1 1 ; 

RGS. 14A and 148 perspective views, each 
showing an outer appearance of another porta- 
ble voice recorder; 

FIG. 15 is a block diagram showing the arrange- 
to ment of a multimedia information recording ap- 
paratus; 

FIG. 16 is a view showing the concept of a dot 
code; 

FIG. 17 is a block diagram showing an arrange- 
rs ment of a multTrriddia ihfbnmation reproducing 
apparatus; 

FIG. 18 is a timing ' chart bHRghtdouroe emission 
in the multimedia information reproducing ap- 
paratus In RG. it; 
20 RG. 19 is a view showing another arrangement 
of this multimedia information reproducing ap- 
paratus; 

FIG. 20A is a view showing a dot code, which is 
also applied to the reproducing apparatus in 

25 RG. 3, to explain a data array adjusting section 
in the multimedia information reproducing ap- 
paratus fn'fte.-i7, : f48L 20&is a viewttiowing a 
lihe& rndfrer & Iftie dot <s&3e in RG. 20A. FIG. 
20C is a view for explaiftirt^ a Scanning method, 

30 and FIG. 2015 is a viertv fbr ^xpiainirig the scan 
pitch of an image piefcup element; 
RG. i\ is a vteto fehQWirig the actual arrange- 
ment of the data prray Adjusting ee&t&r, 
FfGS. 22A fc 8iC am vfews, each showing a 

35 marker having an array effraction detection dot; 

FIG. 23 is a vrfew showing still another drrahge- 
rriefit Of fh& rnuftfthedia Information reproducing 
apparatus; 

RG. 24A is a view for Explaining block ad- 
40 dresses, 

RG. 248 is a view showing the arrangement of 
abtdek. 

RG. 24C is a vl^W showing a marker pattern, 
and 

45 FIG. 240 is a view for explaining the magnifica- 
tion of an image formation gysf&m; 
FIG. 25 Is attack diagram showing the arrange- 
ment of a marker detedi6n section in the mul- 
timedia informaffon repfofifucihg apparatus; 

so FIG. 26 is a ffdy/ effaft shdwtng processing in a 
marker determination section In FIG. 25; 
FK3. 27 id a flow chart Showing processing fn a 
marker area dfetectfon section in RG. 25; 
RG. 28A a tf&tt SKbWtrtg a marker area, RG. 

55 288 & a vtew showing the storage format of a 
tabid f8r SttJfifig a Se&ef^i marker area, iind 
FldS. 28C ahd 28D are views, each showing a 
value o&tafned by accumulating the values of 
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the respective pixels in FIG. 28A; 
FIG. 29 is a flow chart showing processing in an 
approximate center detection section in FIG. 25; 
FIG. 30 is a flow chart showing a center-of- 
gravity calculation subroutine in FIG. 29; 5 
FIG. 31 is a block diagram showing the arrange- 
ment of the approximate center detection sec- 
tion; 

FIG. 32 is a view showing an actual arrangement 
of a data block of a dot code; w 
FIG. 33 is a view showing another actual ar- 
rangement of a data block of a dot code; 
FIG. 34 is a view showing still another actual 
arrangement of a data block of a dot code; 
FIG. 35 is a block diagram showing the arrange- 75 
ment of a data array direction detection section 
in the multimedia information reproducing ap- 
paratus; 

FIG. 36 is a flow chart showing the operation of 

the data array direction detection section; 20 

FIG. 37 is a flow chart showing an adjacent 

marker selection subroutine in FIG. 36; 

FIGS. 38A and 38B are views for explaining 

adjacent marker selection; 

FIG. 39 is a view for explaining adjacent marker 25 
selection; 

FIG. 40A is a view for explaining direction detec- 
tion, and FIG. 40B is a view for explaining the 
relationship between m and n in FIG. 40 A; 
FIG. 41 is a view for explaining another arrange- 30 
ment of a data reverse dot; 
FIG. 42 is a view for explaining another method 
of direction detection; 

FIG. 43 is a block diagram showing the arrange- 
ment of a block address detection/error deter* 35 
mination/accurate center detection section in the 
multimedia information reproducing apparatus; 
FIG. 44 is a flow chart showing the operation of 
the block . address detection/error determina- 
tion/accurate center detection section; 40 
FIG. 45 is a view for explaining the operation of 
the block address detection/error determina- 
tion/accurate center detection section; 
FIG. 46 is a view for explaining the operation of 
a marker/address interpolation section in the 45 
multimedia information reproducing apparatus; 
FIG. 47 is a block diagram showing the arrange- 
ment of an address control section in the mul- 
timedia information reproducing apparatus; 
FIG. 48 is a view for explaining a marker deter- so 
mination formula; 

FIG. 49 is a view for explaining another process- 
ing method of the marker determination section; 
FIG. 50 is a view for explaining marker align- 
ment detection; 65 
FIG. 51 is a view showing the arrangement of a 
light-source-integrated image sensor; 


FIG. 52 is a block diagram showing the arrange- 
ment of a one-chip IC using an X-Y addressing 
image pickup section; 

FIG. 53 is a circuit diagram showing the ar- 
rangement of a pixel of the X-Y addressing 
image pickup section; 

FIG. 54 is a block diagram showing the arrange- 
ment of a three-dimensional IC using the X-Y 
addressing image pickup section; 
FIG. 55 is a view showing an arrangement of a 
pen type information reproducing apparatus hav- 
ing a switch for dot code load control; 
FIG. 56 is a view showing another arrangement 
of the pen type information reproducing appara- 
tus having a switch for dot code load control; 
FIG. 57A is a view showing the arrangement of a 
pen type information reproducing apparatus 
adapted for removal of specular reflection, FIG. 
57B is a view for explaining arrangements of 
first and second polarizing filters, and FIG. 57C 
is a view showing another arrangement of the 
second polarizing filter; 

FIG. 58 is a view showing another arrangement 
of the pen type information reproducing appara- 
tus adapted for removable of specular reflection; 
FIG. 59 is a view showing the arrangement of an 
electrooptical element shutter; 
FIG. 60A is a view showing the arrangement of a 
pen type information apparatus using a transpar- 
ent resin optical waveguide member for a light 
source, FIG. 60B is an enlarged view of a con- 
necting portion between the optical waveguide 
member and a reproducing apparatus housing, 
and FIGS. 60C and 60D are views, each show- 
ing the arrangement of the distal end portion of 
the optical waveguide member; 
FIG. 61 is a view showing the arrangement of a 
pen type information reproducing apparatus us- 
ing a light-source-integrated image sensor; 
FIG. 62 is a view showing the arrangement of a 
pen type information reproducing apparatus 
adapted for color multiplexing; 
FIG. 63A is a view for explaining a color mul- 
tiplex code, FIG. 63B is a view showing an 
application of a color multiplex code, and FIG. 
63C is a view showing an index code; 
FIG. 64 is a flow chart showing the operation of 
a pen type information reproducing apparatus 
adapted for color multiplexing; 
FIG. 65 is a view showing the arrangement of an 
image memory section in a case wherein a color 
image pickup element is used; 
FIG. 66A is a view showing another arrangement 
of the pen type information reproducing appara- 
tus adapted for color multiplexing, and FIG. 66B 
is a view showing the arrangement of a light 
source; 
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FIG. 67A is a view showing a dot data seal on 
which a stealth typ6 dot cods is recorded, and 
FIG. 67B a view feiiftwirta the arrangement of 
a ften type trffonfisffiori reproducthtj apparatus 
adapted for a ste^ttft type dot code; 
RG. 68 is a vfew Showing e dot data seal on 
which a &edfth type dot code Is recorded in 
another form; 

FIG. 69 Is a view showing the arrangement of a 
card type editor having an audio output termi- 
nal; 

R6S. 70 and 71 are views, each Showing the 
arrangement off a cahJ type adaptor for a video 
game app&ratiis; 

RG. 72 is a view showing in application of a 
card type adaptor Tor ah electronic notebook; 
FIG. 73 is a view showing An outer appearance 
of a cafd typfc adaptor for ah apparatus having 
no Input means fcndf eh ^plication of the adapt- 
on 

FIG. 74 is 6 view for explaining how to use a 
reel seal printing iViachinS for printing a dot code 
on a reel seal; 

FIG. 75 is a view showing the internal arrange- 
ment df tfie red! sSal printing machine; 
FIG. 76 is a view showing the arrangement of a 
wordprocessor iricorpor&tin^ a ftkn^tfdh of 
cording a multimedia dot code; 
RG. 77 is a view showing the arrangement of an 
optical copying machine Incorporating the func- 
tion of a multih^dfe ihibrfnatidh recording pro- 
cessing section HtHG. 7©; 
RG. 78 is a vfew shb^g the arrangemSnl of a 
digital copying machine incorporating the func- 
tion of the muitimedfa tnfeifnirtidn fecertfing pro- 
ceed seciidn in RG. 76; 
RQ. 79 is a view showing an arrangement de- 
signed to use a pen typd infbrmation reproduc- 
ing Apparatus as ah input section for character 
and picture data; 

RG. 80 is a vfew showing another arrangement 
-designed td use the pen type inforAtatforf re- 
producing apparatus as an input section fbr 
character and picture data; 
RG. 81 is a View shoeing die arrangefnehtS 6f a 
scanner and a card type adaptor adapted Wr a 
data r&ad operation; 

FIGS. 82A g(H8 62B are views, each showing a 
system for scanning a dot cod& wHffi a p&l type 
information reproducing apparatus art& jirbjee- 
ting the dot code oh a screen by uSng A projec- 
tor; 

FIG. 83 is a view showing the detailed arrange- 
ment of an output processing section in ftGS. 
82Aand 62B; 

RG. 84 is a view showing a case wherein data 
is output to a copyfng machine, a magnetoop- 
ticai disk apparatus, and a printer instead of the 


projector; 

FIG. 65 I? a view showing a case wherein an 
output processing section Is designed as a card 
type adapter; 

5 PIG. 86 a view showing the detailed arrange- 
ment Of trYe output processing section; 
RQ, 87 te a View shoWng art arrangement in- 
cluding a tomnfcf conversion section for cohvert- 
in<f tfie fd/mat of 6m f&r eafch type of wbrd- 

70 processor; : **' : * * 

FIG. 8fi is a view showing the actual arrange- 
ment of the format conversion section; 
FIG, 89 fe k view sfiowihg a case wherein a 
Sheet on which a dot code is recorded is trans- 

75 nlHted/fedel^ed ih faosii&SilW: 

RG: 9«n$ a view showing the arrangement of a 
murtimedia Intormation recording apparatus for a 
feeiifttfle SyStehY; 

RG. 91 is -a view shoving -the arrangement of a 
20 multimedia mforfnatidn recording apparatus in- 
corpi>rate>d in a f^fesimi^ system: 
RG. 92 is 3 view showing an arrangement of an 
overwrite t\^pe MMP card recording/reproducing 
a^pa/afbsr 

26 FfGS. 93A and 93B an? view respectively show- 
ing the lower and upper surface's of an MMP 
card; 

RG; 94' is a view showing another arrangement 
of tfte 6V§H(rHte type -MMP card record- 

30 ittg/reproductng appara&s; 

RG. -95 Ate & vfew Showing stiJi another arrehgp- 
m<&ft t# lite o^Mife type MMP ctttl tecerd- 
ing/reproductag apparatus, and RG. 4S& fe a 
view showing file arrangement of a code pattern 

35 recording «*&8i 

FIGS. 96A arid 96B are views respectively 
showing the lower and upper surfaces of an 
MMPcafti; 

RG. 07 f§ a view showing still another arrange- 
40 rtidnt df the o^rwrtte type MMP card tecbrd- 

ing/reproducfrig afcpatefus; 

RG. 98A is a view showing the arrangement of a 

dire^read^fter-Wiite type MMP card record- 

tng/r^produ6lh§ apparatus, and RG. 98B is a 
46 WdSR dlagtefin fhciwing the ^rangfcffieht df a 

record&d area detection section in RG. 98A; 

RG. 69 fe e # ^$#hg Ihdther Arrangement 

of the redorded £r©a detection gifetfon; 

FIG. 166 is a v%w shewing an MMP card on 
50 whleh a recorded m^ri<er is written; 

F*IG. 101 is a vteft Shoyririg an to/IMP name card 

sy&arti; 

RGS. 1Q2A en£ 1026 are vfefcs respectively 
Shcfwlhg the MJ?f?© r *nd lower surfaces of an 
ss MMP rian^ darid; 

FIGS. 10$A erifcl iqsfif an3 pfcft views showing 
an MMP cand termed 6y a semiconductor wafer 
etching system, in which RG. 103A* sShowfe a 
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state wherein a protective cover is closed, and 
FIG. 103B shows a state wherein the protective 
cover is open; 

FIGS, 104A and 104B aria a plan view and a 
side view showing another MMP card formed by 
the semiconductor wafer etching system, and 
FIG. 104C is a view for explaining the arrange- 
ment of a pawl portion; 

FIG. 105 is a view showing a disk apparatus with 

a dot code decoding function; 

FIG. 106 is a view showing dot codes and 

indexes; 

FIG. 107 is a block diagram showing the ar- 
rangement of the disk apparatus with the dot 
code decoding function; 

FIGS. 108A and 108B are a view and a side 
view showing the arrangement of the rear cover 
of a camera adapted for recording a multimedia 
information data code; 

FIG. 109A is a view showing another arrange- 
ment of the rear cover of the camera adapted 
for recording a multimedia information dot code, 
FIG. 109B is a view showing the arrangement of 
an LED unit, FIG. 109C is a view showing a data 
back-side signal electrode, and FIGS. 109D and 
109E are views, each showing an LED unit mov- 
ing mechanism; 

FIG. 110 is a block diagram showing the ar- 
rangement of the camera adapted for recording 
a multimedia information dot code; and 
FIG. 111 is a view showing photographic printing 
pager pn which a nfiujtimedia information dot 
code is recorded. 

[Best Mode for Carrying Out the Invention] 

Embodiments of the present invention will be 
described below with reference to the accompany- 
ing drawings. An embodiment associated with 
audio information, e.g., speech and music informa- 
tion, of multimedia information will be described 
first. 

FIG. 1 is a block diagram showing the arrange- 
ment of an audio information recording apparatus 
for recording audio information such as speech and 
music information as a digital signal which can be 
optically read according to the first embodiment of 
the present invention. 

An audio signal input through a speech input 
device 12 such as a microphone or audio output 
device is amplified (AGC is performed if the signal 
is a speech signal from a microphone) by a pream- 
plifier 14. Thereafter, the signal is converted into a 
digital signal by an A/D converter 16. This digital 
audio signal is Subjected to data compression in a 
compression circuit 18. An error correction code is 
then added to the signal by an error correction 
code add-on circuit 20. 


After this operation, the resultant data is inter- 
leaved by a memory circuit 22. In this interleaving, 
a data array is two-dimensionally dispersed in ad- 
vance in accordance with a certain rule. With this 
5 operation, when the data is restored to its original 
array by a reproducing apparatus, a burst-like stain 
and flaw on a paper sheet i.e., an error itself is 
dispersed, thereby facilitating error correction and 
data interpolation. This interleave processing is 
70 performed by reading out data from a memory 22A 
through an interleave circuit 22B. 

The output data from the memory circuit 22 is 
modulated by a modulation circuit 26 to be re- 
corded after a marker, x and y addresses indicating 
75 the two-dimensional address of a block, and an 
error determination code are added to the data in 
units of blocks in accordance with a predetermined 
recording format (to be described in detail later) by 
a data addition circuit Data such as image data to 
20 be recorded together with the output data of the 
above audio information is superposed by a syn- 
thesis circuit 27. The resultant data is then pro- 
cessed by a printer system or a printing plate 
making system 28 to be printed. 
25 With this operation, the data is recorded on a 

paper sheet 30 in the form shown in FIG. 2A More 
specifically, the sound data as the digital signal is 
printed as recorded data 36 together with an image 
32 and characters 34. In this case, the recorded 
30 data 36 Is constituted by a plurality of blocks 38. 
Each block is constituted by a marker 38A, an error 
correction code 38B, audio data 38C, x address 
data 38D, ^ address data 38E, and an error deter- 
mination code 38F. 
3S Note that the marker 38A also serves as a sync 

signal. As the marker 38A, a pattern which does 
not generally appear in recording modulation is 
used as in a DAT technique. The error correction 
code 38B is used for error correction of the audio 
40 data 38C. The audio data 38C corresponds to an 
audio signal input through the speech input device 
12 such as a microphone or audio output device. 
The x and y address data 38D and 38E are data 
representing the position of the block 38. The error 
45 determination code 38F is used for error deter- 
mination of these x and y addresses. 

The recorded data 36 having such a format is 
printed/recorded by the printer system or the print- 
ing plate making system 28 in such a manner that 
so the presence and absence of a dot respectively 
represent data of "1 " and data of "0", similar to, 
e.g., a bar code. Such recorded data will be re- 
ferred to as a dot code hereinafter. 

FIG. 2B shows a scene where sound data 
55 recorded on the paper sheet 30 shown in FIG. 2A 
is read by a pen type information reproducing 
apparatus 40. The user traces the dot code 36 with 
the pen type information reproducing apparatus 40 
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shown in FIG. 2B to detect the dbt code 36. Upon 
conversion of tie dot cod<§ Into & sound, the user 
can hear the sdund thrbugh a speech output device 
42 such as an e&rphone. 

FIG. 3 Is a tttoSc diagram showing the arrange- 
ment of the information reproducing appiaratus 40 
according to the first emb^nrfent of thfc present 
invention. The overall information reproducing ap- 
paratus fef this entoodlmertt & housed in a portable 
pen type hbusifi& $tet shfcwtf) except ipr the 
speech output device 42 suet) te a headphone or 
earphone. As is apparent a loudspeaker may be 
incorporated (n the housing. 

• A detection sectioh 44 t^sic^lly has the same 
function as th& of an fmage pickup section su&v as 
a television camera Mor^ spec^ficalfy, «6 dot code 
36 on the surface of the paper sheet as a subject 
to be photographed Is irradiated by a fight source 
44A, and reflected light IS detdCfed, as an Image, 
by an image pickup section 44D constituted by a 
semiconductor £re& sensor arid trie Gke through an 
image formation system 44B such as a lens and a 
spatial filter 44C. ThS detected irffiige is then am- 
plified by a preamplifier 44E to B6 output. 

In this case, the pixel pitch of the area sensor 
is set to be smaller than the dot pitch of the dot 
code 36 on the imaging plane owing to the sam- 
pling theorem. In addition, the spatial filter 44C set 
on the fmaging plane is inserted oft the basis of 
this theorem to prevent a fn<8« effect (aliasing) on 
the Imaging plane. In consideration df 6 shake of 
the detecfion section 44 whfefi It is manually 
scanned a& shown in FIG. 4A, the number of pixels 
of the area sensor is set to be larger tften a value 
corresponding to the vertical width of a predeter- 
mined dbt code 36 prescribed a% the amount Of 
d&ta Which can be redd by one read operation. 
That is, e&ch of FIGS. 4A and 4B shows hOw the 
image pickup area moves at a given period when 
the detectidn section 44 Is manually scanned In the 
direction indicated by the arrow. More specifically, 
>RG. 4A shows a suite of manual scanning wherein 
the vertical width of the dot code 36 Is set Within 
the image pickup area (a shake of thfc image pic- 
kup area is taken into consideration). FIG. 4B 
shows a case wherein the vertical width of the dot 
code 36 canhot be set within the image pibkup 
area in one scanning operation because the 
amount of the dot code 36 is large. In the litter 
case, a manual scanning marker 36A Is printed at 
each manual scannirfg start rioisition of tHe dbt 
code 36 to Indicate the start position. The dot code 
36 in the large amount can be detected by per- 
forming manual scanning a plurality of hMrrtber of 
times along the manual scanning marked 36A. 

An Image signal det&cted by the detectidh'sec- 
tion 44 in the dbove manner is Input to a scan 
conversion/lehs distortion correction Section 46. In 


the seen conversfoh/lOhs distortion correction sec- 
tion 48, fir£t of all, thfe Input frhdge signal is con- 
verted Into e dipittt signal by ah A/0 converter 46A 
and stored in j& freme memory 466. This frame 

s memory 4^B ^ 8^H g^ 

A morker deletion circuit 46C detects the 
markers JftSA bjr^ntimg Image Inforrnation stored 
in file frame mernory 46B in- the manner shown In 
FIGj. 4C. A e detection circuit 46D detects a spe- 

ro ciffis atfdr&ss vito bri the Image pickup plane to 
which ed®i marxer 3[8A detected by the marker 
defection drcuit 46C ibrrespbftds, and calculates 
art ihdihafibh o of the image pickup plane with 
respect to the ^dot code array direction from each 

75 afrdfess va1()e. Nfeite that in scannirtg in only the 
direction ^hSWh ffi HGL 4C, if iftiaglhg of tiie dot 
code 36 is performed while the dot code 36 is 
rofofed thrfiugh almost 90 # from the state shown in 
FIG. 4C, th0 rh^er detection circuit 46G maV not 

20 properly obtain {he inclination 0. For this reason, 
since the inclination Q cannot be properly obtained 
by scanning UHhe Width wise direction, scanning Is 
also |3er%cm%d fn a direetidn perpendicular to the 
above dtfectibh; as shown in FIG. 40. Of the results 

25 obtained by scanning In these two directions per- 
pendicular to ^ach other, a correct one is selected. 

Aberration ifrdrmaWn about a lens used for 
the image fbSnaiieh System 44B of the detection 
section 44, Which information is obtained in ad- 

30 varitie t>y meaSurerherlt and used for lens distortion 
cxiiWdtidn, Is fifored in a lens aberration information 
m^mbfy 4B£ kl reading out data fr.dm the frame 
memory 460, aft address coWo\ circuit 46F sup- 
plies this fr^e miemdry with a read address based 

as ort file inclinatifah e calcumted by the B d&tedtfon 
circuit 46D 6m the terte aberration information 
stewed In the lens aberration information memory 
46E, and performs scan conversion in the data 
array dif~e£09fY while £ertorrftrrt§ data interpolation 

40 in ah irrterpdldfion efrcuft 46G. 

FIG. 5 sfidws the principle bf data interpolation 
performed by the interpolation circuit 468. Ba- 
sically, imen^tated data is created by a convolu- 
tion filter and Art LPF using pixels atound a position 

45 Q *here dm (Wtpr^otefitofh is i^tfOrthfcd. The pixel 
pitch aiid the Seining line plfeh after this sc^n 
conversion £}% set fo be smaller than tKe dbt pitch 
of a dot code dn ttfe basis of the sampling theorem 
as in an imaging qperafibri. 

50 In Simplb data Ihterpol&fion using four pixels 

around the interpolation position Q, interpolated 
diate is created according to Q = (D8 x F6) + (D7 
x Ft) + <6W x f*fO) + (011 x Fit). In data 
interpolation tffith a relatively high pr&SSfon, which 

65 uses i€ pb?01^ around the^sition Q, Irforpoiated 
date Is i»^s^^£^h0 to 4 = (D1 x PI) + (D^ 
x F2) + ... + ff)1^ x Pi 6). Ift these equations, Dh 
is thp data 6m^titude value of a pixel n, and Fn is 
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the coefficient of an interpolation convolution filter 
(LPF) which is determined in accordance with the 
distance to the pixel n. 

The dot code 36 read out from the frame 
memory 46B, which has undergone scan conver- s 
sion in the above manner, is binarized by a 
binarization circuit 48 constituted by a latch 48A 
and a comparator 48B. A threshold value for this 
binarization is determined by a threshold deter* 
mi nation circuit 50 using a histogram value or the io 
like for each frame or each block in a frame. That 
is, a threshold value is determined in accordance 
with a stain on the dot code 36, distortion of the 
paper sheet 30, the precision of a built-in clock, 
and the like. As this threshold determination circuit is 
50, a circuit using a neural network disclosed in, 
e.g., Japanese Patent Application No. 4-131051 
filed by the present applicant is preferably used. 

Meanwhile, the dot code 36 read out from the 
frame memory 46B is input to a PLL circuit 52 to 20 
generate a clock pulse CK synchronized with re- 
production data. This clock pulse CK is used as a 
reference clock for binarization or demodulation 
after scan conversion, and an error detection circuit 
56A, an x, y address detection circuit 56B, and a 25 
memory section 56C in a data string adjusting 
section 56 (to be described later). 

The binarized data is demodulated by a de- 
modulation circuit 54 and input to the error detec- 
tion circuit .56A and the x f y address detection 30 
circuit 56B in the data string adjusting section 56. 
The error detection circuit 56A determines the 
presence/absence of errors in the x and y address 
data 38D and 38E by using the error determination 
code 38F in the block 38. If no errors are present, 35 
the data is recorded on the memory section 56C 
for audio data string adjustment in accordance with 
the address detected by the x, y address detection 
circuit 56A. If any error is present, the audio data 
38C of the block 38 is not recorded in the memory 40 
section 56C for audio data string adjustment. 

The purpose of this data string adjusting sec- 
tion 56 is to correct a small offset caused between 
the data array direction and the scanning direction 
after scan conversion owing to precision (influ- 45 
enced by the precision of a reference clock and 
the S/N ratio of an image pickup element) in the 
above scan conversion and scan conversion in the 
scan conversion/lens distortion correction section 
46, distortion of a paper sheet, and the like. This 50 
operation will be described with reference to FIG. 
6. Referring to FIG. 6, dot codes D1, D2, and D3 
are data of the respective blocks. The pitch of 
scanning lines 1 , 2, 3,... after scan conversion may 
be set to be smaller than the dot pitch of data on 55 
the basis of the sampling theorem, as described 
above. In the case shown in FIG. 6, however, the 
pitch of the scanning lines is set to be 1/2 the dot 


pitch to aim for perfection. As is apparent from FIG. 
6, therefore, the dot code D1 can be detected by 
the scanning line 3 after-scan conversion without 
any failure. The dot code D2 is detected by the 
scanning line 2 after scan conversion without any 
failure. Similarly, the dot code D3 is detected by 
the scanning line 1 after scan conversion without 
any failure. 

The dot codes are stored in the memory sec- 
tion 56C for data string adjustment in accordance 
with the x and y addresses 38D and 38E in the 
respective blocks 38. 

Subsequently, all the speech dot codes 36 on 
the paper sheet 30 can be stored in the memory 
section 56C for data string adjustment by manually 
scanning the detection section 44, as shown in 
FIGS. 4A and 4B. 

The speech dot codes having undergone data 
string adjustment in the data string adjusting sec- 
tion 56 are read out from the memory section 56C 
for data string adjustment in accordance with a 
reference clock CK' generated by a reference clock 
generation circuit 53 different from the PLL circuit 
52 described above. At this time, de-interleave 
processing of the data is performed by a de- 
interleave circuit 58 to convert the data into a 
formal data string. Error correction is then per- 
formed by an error correction circuit 60 using the 
error correction code 38B in each block 38. The 
compressed data is decoded by a decoding circuit 
62. Furthermore, interpolation of audio data which 
cannot be corrected by error correction is per- 
formed by a data interpolation circuit 64. There- 
after, the data is converted into an analog audio 
signal by a D/A conversion circuit 66. The audio 
signal is amplified by an amplifier 68 and con- 
verted into a sound by the speech output device 
(e.g., an earphone, a headphone, or a loudspeaker) 
42. 

As described above, audio information such as 
speech or music information can be recorded on a 
paper sheet, and the reproducing apparatus is a 
compact, portable apparatus. Therefore, the user 
can repeatedly listen to data which is printed out, 
the printed data transmitted in facsimile, or data 
printed in the form of a book by a printing plate 
making technique at any places. 

Note that the memory section 56C for data 
string adjustment in the data string adjusting sec- 
tion 56 is not limited a semiconductor memory, and 
a different storage medium such as a floppy disk, 
an optical disk, or a magnetooptical disk can be 
used. 

Various applications of recording of audio in- 
formation in the above manner can be expected. 
For example, as general applications, the following 
media can be expected: teaching materials for for- 
eign languages, musical scores, various texts for 
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correspondence courses, article specifications, re- 
pair manuals, language dlotiortart&s, ehbyclopediaS, 
books and magazines aach as picture books, cata- 
logs of merchandise, gGftJe boofe for travelers, 
direct mails and InvffeGorr earite. W^pdpdffc rt^ 
azines v le&flets, albums, congratulatory tST^raftis, 
postcards, and the like. As applications in busings 
operations, the foftdwing m&fia can bfe etfpiotetf: 
fax (voice & fax) operation Instmctibns. proceed* 
ings, electronic blackboards, 0Wf*s, ideVitifi&itiOfis 
(voice prlrtfe), name Uriels; telephone rrtdtrtos, la- 
bels, fine paper rolls as supplies (expendable sup- 
plies), arid the like. In this caSS, as Shown In FIG. 
7A. an expandable supply is de&ignfcd such that a 
doubleK^ated adhesive ta^0/ a label, tir tffe lifcfc 
whfcfi pe^s off eSSfly is «iic& on this lower surface 
of i roll of rjaper 30A, dnd the dot codes 38 are 
recorded on the upper surface bf the pap%? 30A. 
Only a required porGoh of the rjaper 30A (to be 
referred to a reel seal hereinafter) can tie cut and 
stuck on various thirtjgs. Aftematfvety. as shown in 
RG. 7B, the #W#i of the pSp&r B<$A may be set to 
be !&ge so that the dot codes S& m£y be recbMed 
in rows. In addition, manual scanning markers 306 
aS guide lines for manual scanning of me detection 
section 44 may be printed vertically ahd laterally . 
These markers 36B c^h also be used as criteHafor 
* the rrcdrdirtg positions of the d6t codes 36. llfeit 
& is, a sensor is arranged ih a printer System £8 to 
~ read the marker 366 so as to d£te<^ the Start 
^ position of a fh^MJt fjidsitoh. With tfite' oj^riflbri; 

the dot code 36 c^n bfe printed WrtHin th$ area 
^ ertbtosed with this mantiaJ sc^rmlrt^ rhSrk^r 366 
" without fail. Therefore, by j^rforrrrfng a rftantfai 
scanning operation along the manual scanning 
marker 36B, the recorded audio fntorrriatitfh can b6 
refiabfy reproduced. As Is atf&reffi, the manual 
scanning marker 36B may be printed at the same 
time when the dot code 30 id pffrlted. 

Consider the recording time of audio informa- 
tion. In general 200-dpl facsimlfe, when, for exam- 
ple, data Is recorded In an drea 6f 1 in. x 7 In. 
(2J54 cm x 17.76 cm) aldftg one side of d pfc$>er 
sheet, the fot£l amount of tftfc data is 280 kbits. 
When a poftfbn (30%) corra$ptifndfirig fe a marfcer. 
an eddress Spal, sin errfcr airrkbiidh code, and an 
error deterrrti^ code (Hi thfe etee, the Srror 
deterrnmatidn codS is Sft fdr not briTy the x ariS y 
acfd're^ses 386 SB S8E but af$o th6 au<5o dtfe 
38C) is subtracted from the above data, fhfc fcmdUnt 
of the rerrminiftg data IS 1 96 kbits. Therefor^, When 
speech data is <xJrf#resseti at 7 kbfte/s t^he bit rate 
in mobile co-location), the rScbrfiinb time of 
the ddfe ft 28 fefc. VWeh data te tb'bfc raided on 
the entire lower siirfci& of an A4-slze tfrt>-itfcfe 
facsimile sh£&, gfft*s6 an area of 7 in. x TO in. 
(17.78 cm x 25.4 crft) &n te ertsiirfed. speetfi data 
of a duration of 4.7 mfris can be recorded. 


In 400-dpJ Q4 facsimile, according to the same 
calculation as described above, speech date of a 
duration of ia8 rtilrtfe dan be recorded in an area of 
7 in, x to to. 

s In 1^6-dpl high-quality printing, according to 

th$ e^troe o^lltrtj l&ti on as d^Sribed above, speech 
data 6f a du/atjOh of 52.3 s$c cart be recorded in 
an ar&i # 6 ritth x 30 mm. In a tape-liks area of 
10 mm ; x 75 mm, speech data of 1 min can be 

io recorded, ai^bording (0 calculation b&sed dn a 
speech signal of high soliria quality (30 KMits/s 
up(fo compression) which allows recording of even 
niusl^dsta. 

4=i& 6 ^hows the arr^rfgement of the Second 
75 embodiment bf the present invention. In the second 

tioh $6&h aS a Cl^lD capable of memory and ran- 
ddfh atee ss are used. The second embodiment is 
different from thS first embodiment only in the 

20 detectidn section 44 and the scan conversion/tens 
distdftion fedrrectfOh section 46 of the reproducing 
ap^a^s. More ^lidfically, m a detection 
tion^eah ^ 70, irtfgge 

stored in an x*y addressing image pickup section 

25 70A te ^ibjec^d to marker dbleetron fn the samfe 
manrter aS 61 the first embodiment In r^irfg but 
trfd dSta, fbur data abund an Inter^l^fldfi positibn 
are sdquehtiaily read am by an addrdis genferatioi 5 ! 
section 706 and x ari a d ^ h&6d&fe 7fifC and TOO, 

so and input to an interpolation section 72. In the 
inteit>6miion section 72, cdeftid^nts lure sequen- 
ti§llj resfi out frdm a Coefficient generation circuit 
Tdfe $m itiuWplfed lb the th^-dg^t by a mu^flier 
70^. The products are at^mutoed/arfd^d by an 

35 analog acCurhu(atihi^adfti6h drd^t c6nstift?ted by 
an adder a ^rr^fe Wi bold ^rd&H 7VH, and 
a switch 701. the resultant daid ts then Sam- 
pled/held by a sample and hold circuit 70J, ahd a 
d6t cbQ*e hAVing undergone sc&h conversion is 

40 supplied to the bfnari2ation circiSit 48, the threshold 
value determination circuit 50, and the PLL circuit 
52 described abovb. 

With thfs arrangement, the same function afe 
that of the first embodiment can be reali^d, and 

45 the frame memory 46 <&h be omltfdd, thereby 
realizing a r^duetiori in the cost ^nd siz'e df the 
app^Mus. In ifdditign, if m x^y add?es^ng Irtfego 
pickup section 70A, the address generation section 
70B f the d§€fodef^ 70C and fob, ind 9A tntfirfbla- 

50 tton section 72 are formed on one substrate to be 
irTtegrated into ah lp, a further reduction ih size can 
be realized. 

Fid. 9 shows the arraignment of frie thifd 
emfifidiment of th§ present invention. 1n this em- 
55 bodimbnt a dSt dode is FebordiO oh a pap^r 
sheet 30, on wffi^i f^ct^^s and characters ite 
printed, by u^Ing a tr%rt§^§m paint (ink) 74 which 
easily c&Uses specular reflection (tofkl irrferfml re- 
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flection). Polarizing filters 44F and 44G are ar- 
ranged between a light source 44A and an image 
forming system 44B in a detection section 44. The 
polarizing surfaces of the polarizing filters 44F and 
44G are adjusted such that reflected light from the 
inside (the upper surface of the paper sheet 30) 
and reflected light from holes 74A formed in the 
transparent paint 74 according to a code are po- 
larized in various directions and cut by the polariz- 
ing filter 44G by 1/2 the total .amount of., light In 
addition, since the different in light amount be- 
tween normal reflected light and totally reflected 
light is large, the contrast of the dot code recorded 
with the transparent paint 74 is emphasized and 
imaged. 

Furthermore, the surface of the paper sheet 30 
may be subjected to surface treatment such as 
mirror finishing to allow easy specular reflection, 
and the transparent paint 74 may consist of a 
material having a higher refractive index than the 
surface having undergone the above surface treat- 
ment and a film thickness corresponding to about 
X/4 (corresponding to an optical path length of 1/4 
in the transparent paint in consideration of a 
change in optical path length because of an in- 
cident angle). With this arrangement owing to the 
effect of the reflection amplifying coat, light which 
is obliquely , incident on the surface of the paper 
sheet 30 is further amplified and reflected (specular 
reflectjon) more easily. 

(n this case, for example, a dot code is formed 
by fine chemical etching or the lite, and hole 
portions corresponding to dots are roughened to 
reduce their reflectances. 

If the dot code 36 is recorded in the transpar- 
ent paint 74 in this manner, dot codes can be 
recorded even on pictures and characters. When, 
therefore, dot-codes are to be recorded together 
with characters and pictures, the recording capacity 
can be increased as compared with the first em- 
bodiment. 

Instead of the transparent paint, a transparent 
fluorescent paint may be used. Alternatively, dot 
codes qnay be recorded in color to realize multiplex 
recording. In recording dot codes in color, a gen- 
eral color ink or a color ink obtained by mixing a 
coloring material with a transparent ink may be 
used. 

In this case, for example, an ink consisting of a 
volatile liquid and a binder (e.g., phenolic resin 
varnishi linseed oil varnish, or alkyd resin) can be 
used as a transparent ink, and a coloring material 
can be used as a pigment. 

A portable voice recorder to which an audio 
information recording apparatus is applied will be 
described next. FIGS. 10A and 10B show an outer 
appearance of the portable voice recorder. This 
portable voice recorder is constituted by a main 


body 76 and a speech input section 80 which is 
detachably mounted on the main body 76 through 
main body-side and speech input section-side de- 
tachable members (a surface fastener, a magic 
s tape, and the like) 78A and 78B. A recording start 
button 82 and a discharging section 84 for printed 
sheets are arranged on surfaces of the main body 
76. Note that the main body 76 and the speech 
input section 80 are connected to each other via a 
10 cable 86. As a matter of course, signals may be 
transmitted from the speech input section 80 to the 
main body 76 by radio or infrared radiation. 

FIG. 11 is a block diagram showing the ar- 
rangement of this portable voice recorder. Speech 
15 input through a microphone 88 is amplified by a 
preamplifier 90 and converted into digital data by 
an A/D converter 92. The data is then supplied to a 
compression processing section (ADPCM) 94. An 
error correction code is added by an error correc- 
20 tipn code addition section 96 to the data having 
undergone compression processing. The resultant 
data is supplied to an interleave section 98, and the 
respective data are stored. Thereafter, interleave 
processing is performed. In addition, addresses of 
25 blocks and address error determination codes 
(CRC or the like) are added by an address data 
addition section 100 to the data interleaved in this 
manner. The resultant data is input to a modulation 
circuit 102. The modulation circuit 102 performs, 
30 for example, 8-10 modulation, i.e., conversion from 
8-bit data into 10-bit data, thus converting the data 
into data having a different bit count. After this 
operation, a marker addition section 104 generates 
markers by using a data string different from 256 
35 data strings correlated in the modulation circuit 
102, and adds the markers to the data. 

The data to which the markers are added in 
this manner is supplied to a simple printer system 
106. As a result as shown in FIGS. 12A and 12B, a 
40 reel seal 108 is printed and discharged from the 
printed sheet discharging section 84. In this case, 
the simple printer system 106 prints date/time data 
obtained by a timer 1 10 on the reel seal 108. 

Note that each component described above is 
45 controlled by a control section 112 in accordance 
with the operation of the recording start button 82. 
Of the above components, the microphone 88 and 
other components to be arranged in the speech 
input section 80 are not specifically limited. In this 
so case, for example, the microphone 88, the pream- 
plifier 90, and the A/O converter 92 are incor- 
porated in the speech input section 80. 

FIG. 13 is a flow chart showing the operation of 
the portable voice recorder having the above ar- 
55 rangement When the recording start button 82 
arranged on the main body 76 is depressed (step 
S12), processing from speech input to printing of a 
dot code 114 on the reel seal 108 is performed 
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(step S16) while the recording start button 82 is 
depressed (step $14). When the recording gfert 
button 82 is released, it is decided whether the 
recording start button 82 is depressed again within 
a pr^etermined period of tithe {step St8). ff It ts 
decided that the recording stert button B2 is de- 
pressed again, the flow returns to step 814 to 
repeat the above processing. If ft is detoirffiined mat 
the recording start buttoh 82 1s not depressed 
within the predetermined period of time, the current 
data and time are referred to through the timer 110 
(step 820), arid the referred date and time are 
printed while a margin portion 1 16 of the reel seal 
108 is fed. 

In this portable veice recorder, as showri ;ln 
FIG. 10A, while the maih body 76 1$ cbnnect^d to 
the speech input section 80. the user holds the 
main body 76 with his/her hand &hd records 
speech, as the dot code 114, oh the reel 6eal 108 
with me speech input section 80 being brought 
near to his/her mouth. Alternatively, as shown In 
FIG. 10B, the main body 76 and fee speech irlput 
section 80 are separated from each other, and the 
speech input section 60 is attaCtfeti 1S6 iffe recover 
~ side of the handset of a telephone set by usirlgj the 
^ detachable member 78B. With this anrangdrttent, 
^ this user ckt directly record speech from a person 
^ on the other end of a telephone fine, as the dot 
^ code 114, on the reel seal 108 instead of writi rig 
: * the contents of the speech <Sh a memo. In mis 
case, as shown in FKaS: ISA did 12S. flte nametff 
^ me receiver or a commenS indicating an adtfrd$se§ 
- or the fike can be written, in addition & ds^me 
data printed on the reel seal 108, because the 
margin portion 116 b formed. 

As me speech input section 80; various forms 
can be considered, as well as the above arrarige- 
ment allowing me speech ifcput section 80 to be 
detachabiy mounted on the main bbdy via me 
detachable members. Fdr example, a& shown in 
FIGS. 14A and 14B, an earphone type may be 
used. If such an earphone type §£dech Input sec- 
tion 80 is employed, the speech Input section 80 Is 
pulled out from & speech Input section housihg 
section 1 18 of the main body 76 ahii irfeerfed irt ah 
ear of me user. With mis arrangement the user 
can record speech from a pkHofi 6n tfte otfief eWd 
of a telephone line white listening to fife Speed) 
through me receiver Sifife of the handset of (Re 
telephone. 

in the above description, dot code printing is 
performed only while the retarding start button 62 
is depressed. However, a recording eftd button 
may be Arranged on tft6 main body 76 so trf^tt dot 
code printing may be performed In the Mf&vaf 
between tFte irt&thnt eft Which me recording start 
button 62 is depressed ofte© aria me IrtStatlt at 
which me recording end buftort is depressed. 


A reproducing function like me one shown in 
FIG. 3 may be incorporated tn me recording ap- 
paratus to form a recordingto3produdng apparatus. 
In mis case, the e^t&one^ty}^ epedoh Input see- 

5 tion 80 rriay teste the fuftdU&f or fch earphone. 

In the ab6v0 embodiment audio Information 
£uch as speech and tousle irifbrmatidn is presented 
as inforifiatitfh : to be recorded. However, an em- 
bodiment designed t$ ftapdie soiled multimedia 

10 timm&W tocaptflito rtdt dnly eaard imoimation but 
at§b vR&o iriftfo^rt obteMed by a camera, a 
video tape recorder, and m© like and digital code 
dat$ obtained ffdnr a pecfeon^n computer, a word- 
processor, ahtfme life *ilftji§tfaSefi6is*bd1ew. 

75 FIG. 15 $ a bt(§clc digram *h&tfjrtg the ar- 

rangement a rt«3teftit8^a - Irtfoitfftfifflcft recording 
apparatus for recrofdirtS ^uch multimedia informa- 
tion 

Of multimedia Information audio information is 

20 input through a rhicropHorte & audio output device 
1233 arid amplified by a preampfifier 1Q£ t Arid the 
arhpIGM fftfeijm^tfn is detfv&ted into digital data 
by an A/D cohv^r 124 arid supplied to a com- 
presSioh processing section 126, as in me case 

25 shd#n ift FIG. 1. < 
In the compression processing section 126, the 
input digital sfadio^signal is ^tectively supplied to a 
speech cfcm^sslftg circuit 180 such as an 
ADPCM circuit and ! *a speefch synme^/coding oir- 

30 curt 13& by a switch 128. The speecri compressing 
circuit *80 performs adaptive typd differential PCM 
df the ifcjsut digital aiidid information to perform 
data cOiftpre^idn. Ttte Speech syrrthe6T$/eoding 
cfr&ftt 132 rebbgrrtzes one sp6e6h IrfpOt from me 

35 input digital audio information and converts it into a 
code. With thffe c^^SBot, mi digits audlb informa- 
tion is temporarily converted into a different syn- 
thetic oed6 to relative^ reduce the data arhbynt as 
against a c^se Wh^tn me above ADPOM drcuit 

40 codes the audio information tn me form 6f speech 
information to retftiee the data amount, i.e., pro- 
cesses the aaBio ihformiafio'rl afe raW information. 
For Example, the switch 128 Is manually dper&ted 
by me user in accordance vfith & purpose. Alter- 

45 nativity, fbr example, ihfbrmaticn ay be eate- 
gorized iti advance Such that information with high 
sourtd quality stoh as irifdfmatidrt frdm me audio 
output device is s\i$p\\§6 td the speech cdrnpress- 
irtg circuit 130, and voices cjSS 6^rfrriiehts from me 

so microphone are supplied to the speech synthe- 
sis/coding circuit 132. With tffts arr&rigefharit irtpiit 
audio informafibn carl be automatically switched 
aftdr me information is reco^ftiied as information 
btt&fpi8 to 6 specific cat^ofy. 

65 VstflSyS dala Input mimigh a personal com- 
puter, a wtWptec6&k>r, a OAO, ah* §lectrofilc note- 
book, communication, and me ilke, which have 
already been formed as digital code data, are input 
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to a data form determination circuit 136 first via an 
interface (to be referred to as ah l/F hereinafter) 
134. The data form determination circuit 136 ba- 
sically serves to determine whether data compres- 
sion can be performed by the compression pro- 
cessing section 126 on the subsequent stage. In- 
formation which has already undergone some com- 
pression processing and from which no effect can 
be expected in the compression processing section 
126 on the subsequent stage is made to bypass 
the compression processing section 126 to be di- 
rectly supplied to the subsequent stage of the 
compression processing section 126. If input data 
is non-compressed data, the data is supplied to the 
compression processing section 1 26. 

Data which is determined as no-compressed 
code data by the data form determination circuit 
136 is input to the compression processing section 
126, in which; compression processing of optimally 
compressing the code data is performed by a 
compressing circuit 138 using Huffman codes, 
arithmetic codes, Lempel-Ziv (LZ) codes, or the 
like. Note that the compressing circuit 138 also 
performs compression processing . of an output 
from the above speech synthesis/coding circuit 
132. 

Note that the speech synthesis/coding circuit 
132 may recognize character information, as well 
as speech information, and convert it into a speech 
synthetic code. 

Image information from a camera or video out- 
put device 140 is supplied to the compression 
processing section 126 after being amplified by a 
preamplifier 142 and A/D-converted by an A/D con- 
verter 144. 

In the compression processing section 126, an 
image ^ea deten^ation/§eparation drcuit 146 de- 
termines whether input image information is a bi- 
nary image such as a handwritten character or a 
graph or a multi-value image such as a natural 
image. This image area determination/separation 
circuit 146 separates binary image data from multi- 
value image data by using a determined image 
area separation technique using a neural network 
as disclosed in Japanese Patent Application No. 5- 
163635 filed by the present applicant Binary im- 
age data is compressed by a binary compression 
processing circuit 148 such as a general 
MR/MH/MMR according to JBIG or the like as 
binary compression. Multi-value image data is 
compressed by a multi-value compression pro- 
cessing circuit 150 using a still image compressing 
function such as DPCM or JPEG. 

The data which have undergone compression 
processing in the above manner are synthesized 
by a data synthesis processing section 152 as 
needed. 


Note that all the respective information input 
and compression processing systems need not be 
arranged in parallel, but one or a combination of a 
plurality of systems may be arranged as needed. 

5 Therefore, the data synthesis processing section 
152 is not always required. If only one data system 
is present, this section may be omitted so that data 
can be directly input to an error correction code 
addition section 154 on the subsequent stage. 

w The error correction code addition section 154 

adds an error correction code to the data and 
inputs the resultant data to a data memory section 
156. In the data memory section 156, the respec- 
tive data are stored, and undergo interleave pro- 

75 cessing afterward, in this operation, a continuous 
data string is dispersed to positions properly sepa- 
rated from each other to improve the correction 
performance by minimizing errors, e.g., block er- 
rors caused by noise and the like, when input data 

20 is actually recorded as dot codes, and the dot 
codes are reproduced. That is, the possibility of an 
error is reduced from that of a burst error to that of 
a bit error. 

Furthermore, an address data addition section 
25 158 adds addresses of blocks and address error 
determination code (CRC or the like) to the data 
interleaved in this manner, and inputs the resultant 
data to a modulation circuit 160. For example, the 
modulation circuit 160 performs 8-10 modulation. 
30 In the above embodiment, as is apparent, 

codes for error correction may be added to data 
after interleave processing. 

After this operation, a marker addition section 
162 generates markers using a data string different 
35 from 256 data strings correlated in the modulation 
circuit 160, and adds the markers to the data. 
Addition of markers after modulation prevents the 
markers from being modulated and rendered dif- 
ficult to be recognized as markers. 
40 The data to which the markers are added in 

this manner is sent to a synthesis/edit processing 
section 164 and recorded on a recording paper 
sheet other than the created data. For example, the 
data is synthesized with an image, a title, char- 
ts acters, or the like, or subjected to edit processing 
such as layout processing. Alternatively, the data is 
converted into a form to be output to a printer or a 
data format suitable for a printing plate and is 
supplied to a printer system or a printing plate 
so making system 166 on the next stage. Finally, in 
the printer system or the printing plate making 
system, the data is printed on a sheet, a tape, 
printed matter, or the like. 

Note that edit processing in the synthesis/edit 
55 processing section 164 includes edit operations 
such as layout processing of information on a pa- 
per sheet and dot codes, matching of the dot size 
of codes with the resolving power of a printing 
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machine, a printer, or the like, and delimiting a 
code tength In units of words, in accordance with 
contents, or the like, to perform a line feed opera- 
tion, i.e.. a line feed operation of feeding a given 
line to the next line. 

The printed matter obtained in this manner is 
transmitted by, e.g.. a FAX 168. As a matter of 
course, data created by the synthesi6/edit process- 
ing section may be directly transmitted in facsimllb 
instead of being printed. 

The concept of a ddt code 170 in this embodi- 
ment will be described below with reference to FtG. 
16. According to the data format of the dot code 
170 in the etabodiirftetft, one block 1*2 is cSh- 
stituted by a marker 174, a block addres§ 176, 
address error detectfon/error correction data 178, 
and a data area 180 in which actual datk is set. 
Tfifet is, in this embodiment, one block Is devel- 
oped two-dimensiona!ly unlike the embodiment de- 
scribed with reference to RG. 2A f in which one 
block is arranged one-dimerisiohally in the line 
direction. Such blocks 172 are two-dimensionally 
arranged in the vertical and horizontal directions to 
form the dot code 170 as a whole. 

The arrangement of a reproducing apparatus 
for multimedia information will be described next 
with reference to FIG. 17. This informafiofi re- 
producing apparatus comprises a detection section 
184 for redding a dot code from a sh&bt "182 on 
which the dot code 170 is printed, a scan conver- 
sion section 186 for recognizing Image data kip- 
plied from the detection section i84 as a dot code 
and normalising it, a binarization pnod^Shg sec- 
tion 188 for converting multi-value data ffito binary 
data, a demodulating section T90; an a^u^ting 
secfion 192 for adjusting a data string, a d&& drror 
correction section 194 for correcting a read &nror in 
a rgproducfhg operation and a data error, a dfiSa 
separation section 196 for separating date in afccor- 
dance with their attributes, an decompression piro- 
ce&&rtg section for performing prbcessto§ gainst 
data compression processing in a66ordart^ with 
the attributes of data, and a display section, a 
reproducing section, or another input device. 

In the detection section 184, the dot code 170 
on the sheet 182 is illuminated with a light Source 
198; reflected light is detected as art imajS "A^fttfl 
by an frihage pickup section 204 such a£ & CCD or 
a CMd, denned to convert o^cal !nfBrrrra66n1nto 
an electrical signal, via ah image forfrtatiori optical 
system 200 such as a lens &hd a Spatial fitter 202 
for removing moirfi and the like; and the Image 
signal is ampflfted by a pr^dmpfiffer 2d6 to be 
output. The light source 198, the image f&tiftdGon 
optical system 200, the spatial filter 202, the image 
pickup sectidn 204, and the preSftptffier 2&8 am 
arranged in an external light shielding eec&oh 208 
for preventing disturbance caused by external light 


The image aortal amplified by the preamplifier 208 
is converted into digital tfiformatioh by an A/D 
conversion Stodrt 2TO ^supplied to me soan 
conversion Section 186 on thg next stage. 

5 Nbte that tits imagfe pWtoup section 204 is 

controlled by an Image tffcWf) Seoffoh control seo- 
tidh' 2l^r. As&uf^e that ^ ^D df an in&rrtrie trprfcJer 
schefne is to b§ u^ti a$ (he tm^ge pickup sefetion 
204. In this case, th6 imago pickup Action control 

io section ^12 outputs the follcfwtng coitiftA signals to 
the image pickup secfion 2<% a vertical blanking 
sfgfnal for >aHar^bal sYit^roftfse&an; ah image pickup 
eldfhertt reset pu#e for resetting trlform&tion 
charges; a el&i$e tf^riifdr g£te fflitee signal for 

75 tr^sferririg charg§§* §for§cf in a twb-dimensiohaily 
arrayed dhargp tterfef§r/§tdta3e section to a plural- 
ity of Vertical Shift refcfteftte; a hbffeont^i charge 
transfer CLK $i§rt&l ell a ttertsfer deck signal for a 
hor&ontaa shft In 

20 the hortzbntal direction aritf extemafly outputting 
them; a vertical charge transfer £uise stgnal for 
transferring die charges from the' vertical shift reg- 
isters in the vSrti&al diiSgfioft afBdl stipplyihg thBTn 
to the horMm^i shift regtfSr, and the like. RG. 18 

25 shows the tfmii^ ^ftt^a trials. : 
Thfc Image pickup Action control section 212 
supptfes ah ertiisslon cell control pulse to the light 
source 198 to h6just the emission timirtg of the 
light source 198 iri accdrdahce with the above 

30 timings. 

The timirtg chart in FIG. 18 basically corre- 
sponds to one field. imgge data is read out In tftb 
tirrte frtterv^l between one bfenWng flhtfnjj and the 
other bfanf&rt^r rirfiir^ of ofte Ml Instead of corv 

ds tinuously figMtftg the light source 198, a pulse 
lighting operation is performed, and subsequent 
ptfisfe fighting operations are performed while syn- 
chrdhlzafioh is est&jH$Ehe<| in tmlts of ffelds, in this 
case, ftfe exposure timing is controlled to pSffdrrh 

40 exposal durirfg a vertical bfenWng period, i.e., a 
per16d during Which no im£g& charges are output 
in order <b pretemt clock nof§e caused by a pUlSe 
lighting ojSei^tioh from mixing with 6 signal output. 
That &. ah &«fe4idn ceil ctttltrst jfutse is a tfery ffite 

45 digital clock pulse whlc$ is Senermed Instant^- 
neousty arid serves to supply VtoQO poWer to {he 
light soutee. Pair ffefe t&tikri, soife ;it*Ssurb jrh'i«t 
be tekgn t6 pffev^nt no^^ from mbcfftp witfi an 
analog image £igngi< For ftfs reasoh, pul3e lighting 

so of the light soared is p^ofMId durfhg a vertical 
blaftehg p&ildd. Wftti rtitf offcratiori, thb S/k ratfb 
can tte IncMf^ed. Ih Icpfion, to perfbrm pulse 
UgAtind. Is to ^oryn ttte dftife^bn time, therefore, 
the rnffii^nc^s of a sh^kp cai/sed by a manual 

55 opemtion and bWrtliig caused by movei'nerlt of the 
atfirp&Stits carl bb e¥rhfn^d. this allows a high- 
speed so6rihfttg operation' 
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In addition, assume that the reproducing ap- 
paratus tilts, and disturbance 6uch as external light 
enters in spite of the external light shielding section 
208. Even in this case, in order to minimize a 
decrease in S/N ratio, an image pickup element 
reset pulse is output to reset an image signal once 
before the light source 198 is caused to emit light 
during a vertical blanking period, and emission of 
light is performed immediately after resetting of 
this image signal. A data read operation is per- 
formed immediately after this operation. 

The scan conversion section 186 will be de- 
scribed below with reference to FIG. 17. The scan 
conversion section 186 is a section for recognizing 
image data supplied from the detection section 184 
as a dot code, and normalizing it. As a technique 
for this operation, the image data from the detec- 
tion section 184 is stored in an image memory 214, 
read out therefrom temporarily, and supplied to a 
marker detection section 216. The marker detection 
section 216 detects a marker of each block. A data 
array direction detection section 218 detects the 
rotation or inclination and the array direction of the 
dat^ by using the markers. An address control 
section 220 reads out image data from the image 
memory 214 and supplies the data to an interpola- 
tion circuit 222 so as to correct it in accordance 
with the detection result At this time, lens aberra- 
tion information is read out from a /riempry 224 for 
correcting the distortion of the aberration of the 
lens of the image formation optical system 200 of 
the detection section 184. thereby performing lens 
correction as well. The interpolation circuit 222 
performs interpolation processing of the image data 
to convert it into an original pattern, i.e., a dot 
code. 

An output from the interpolation circuit 222 is 
supplied to the binarization processing section 188. 
As is apparent from FIG. 16 as well, the dot code 
170 is basically a black and white pattern, i.e.. 
binary information. Therefore, the data Is converted 
into binary data by the binarization processing sec- 
tion 188. At this time, binarization is adaptively 
performed while threshold value determination is 
performed by a threshold value determination cir- 
cuit 226 in consideration of the influences of distur- 
bance, signal amplitude, and the like. 

Since modulation like the one described with 
reference to FIG. 15 has been performed, the de- 
modulating section 190 demodulates the data, and 
inputs the resultant data to the data string adjusting 
section 1 92. 

In the data string adjusting section 192, the 
block addresses of the above two-dimensional 
blocks are detected by a block address detection 
section 228 first, and error detection and correction 
of the block addresses are then performed by a 
block address error detection/correction section 


230. Thereafter, an address control section 232 
stores the resultant data in a data memory section 
234 in units of blocks. By storing the data in units 
of block addresses in this manner, the data can be 
5 efficiently stored even if an intermediate data por- 
tion is omitted or data is inserted in the process of 
storing the data. 

After this operation, error correction of the data 
read out from the data memory section 234 is 
70 performed by the data error correction section 194. 
An output from the data error correction section 
194 is branched to two ways. One output is sup- 
plied, as digital data, to a personal computer, a 
wordprocessor, an electronic notebook, or the like. 
75 The other output is supplied to the data separation 
section 196 to be separated into image data, hand- 
written character or graph data, character or line 
drawing data, and sound data (including two types, 
i.e., sound data without any processing and data 
20 having undergone speech synthesis). 

Image data corresponds to natural image data, 
which is multi-value image data. An decompression 
processing section 238 performs decompression 
processing of this data, which corresponds to 
25 JPEG in data compression. In a data interpolation 
circuit 240, data for which error correction cannot 
be performed is interpolated. 

For binary image information as of a hand- 
written character or a graph, an decompression 
30 processing section 242 performs decompression 
processing corresponding to MR/MH/MMR in data 
compression. In a data interpolation circuit 244, 
data for which error correction cannot be per- 
formed is interpolated. 
35 Character or line drawing data is converted into 

a different pattern for display by a PDL (Page- 
Description Language) processing section 246. 
Note that even line drawing or character informa- 
tion which has been coded and undergone com- 
40 pression processing for a code is subjected to 
corresponding decompression (Huffman coding, 
Lempel-Ziv coding, or the like) processing in an 
decompression processing section 248, and is sup- 
plied to the PDL processing section 246. 
45 Outputs from the data interpolation circuits 240 

and 244 and the PDL processing section 246 are 
synthesized or selected by a synthesiz- 
ing/switching circuit 250. The resultant data is con- 
verted into an analog signal by a D/A conversion 
so section 252. Thereafter, the corresponding informa- 
tion is displayed on a display section 254 such as 
a CRT (TV monitor) or an FMD (face mounted 
display). Note that the FMD is a glasses-type moni- 
tor (handy monitor) to be mounted on the face of 
55 the user, and can be effectively used for, e.g., a 
virtual reality operation or looking at an image on a 
large frame in a narrow place. 
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Speech information is subjected to decompres- 
sion processing in an decomprfcsSlbn processing 
section 268, which cojtespfo'nds to ADPCR Fur- 
thermore, in a dtefta int^rpotaticm circuit 258, d£ta 
for which error cbneotfdW cahncft be parformed is 
interpolated. In perforrHlfig Speech syndesis, a 
speech synthesis sectfqn 2tf0 receives a code for 
speech synthesis, afeWally synthesizes Speech 
from the code, arid outputs ft In this base, if the 
code itself is GorhpresSfed, speech syrithesis is 
performed after decompression pftcSssing such as 
Huffman coding or Lempel-Ziv coding processing 
is performed in an decompression processing sec- 
tto«2e2 f as in tfi6 case* of the d&fce oh&racter or 
One drawing tnforMStioh. 

Furtherfhore, as shown in FIG. 19, character 
information may be output, as speech information, 
from the speech synthesis sedtfdfr $60 after sen- 
tence recognition is performed by a sentence fee* 
ogrtftion sectidn 271 . 

The decompression processing section 262 
may also serve as the decompression processing 
section 248. in this cas^, date is properly switched 
by switches SWl, SW% arid SW3 in accor^larii* 
with the attribute of the data subjected to de- 
compression processing so as to Ba Ihplit to the 
PDL processing section 246 or the speech Synthe- 
sis section 260. 

Outputs from the data interpolation circuit 258 
and the speech syrrthelis section 260 are syn- 
thesized or selected by a Synthesizing/switching 
circuit 264. The resultant data is then concerted 
into 4n analog sfgnal by a D/A cblWersion sectfbrY 
266. The signal is output to a loudspeaker, a head- 
phone or a speech output device 268 equivalent 
thereto. 

Character or line drawing information fa directly 
output from the data separation section 196 to a 
page printer or plotter 270. As a result, the char- 
acter information can be printed, as wordprocessor 
characters, on a paper sheet or the line drawing 
information can be output as a drawing, from a 
plotter. 

As is apparent, image inform atioh cah also be 
printed by a video prirttfer as well as being dis- 
played on a CRT or an FMD, or the image can be 
photographed. 

The data string adjusting section 192 will be 
described next. Iri this ca&4, in order to apl>Jy this 
embodiment to the audio information reproducing 
apparatus (see FIG. 3) described above, ft Is as- 
sumed that blocks, in eatih of \vhidh a block ad- 
dress 272A and an errar correction ddt& 272B, 
each denoted by reference riurWgral 272, are ar- 
ranged on the first Una, are two^Mfeh^naDj ar- 
rayed, as shown in Pl6. SOA, wfdle linear barkers 
274 sh6*n in FIG. 2dS are arranged in tfie vertical 
direction, and a fine address 276A a/id an error 


detection data 2766, each denoted by reference 
numeral 276, are erraihged for each line of each 
btbck. 

In this embodiment as sftown In RQ. 20C. the 

s pitch is reduced tw1p§ ior 6££h Un6 as compared 
with the scaring me^dT described with reference 
tb F(Q. 6. A0 m mfo # 6acSh riiifcer Is cfe- 
tedted. a pti^ ; M^#rt:;*e antral Rhea of the 
respective adjacent makers are divided into equal 

w portions e^uat fo tfte ^ntirhber twice the number of 
dots. That is, as shown In FIG. £0D, in the first 
scanhing operaticffi, 1/8 th& daft of dots 278 are 
read in the vertical ancf K^M^tdl dire^{ins, Le M a 
total of 1/4 the data is c©|& fh this case, m 

is scanning itifch is e<|U&l tb tfie pHeh i# the dote 27£. 
Therefore, da^is re£d fttftogfy other dot. In this 
mariner, data is read uf) to the CRC error detection 
data 27ea tf, fdr 5 S^^Ob; one block consists of 64 
dots. 64 d6fc are re§df<# $very dther dot 

20 Whether a Ifne a'ddiessf Is actual^ tead is 
checked by usin$ the'tfrie SStre^s £7i&& Sbc&ted at 
a Ireafr poftiofi 0fTd the etrot ifetedfon data 
278B for me ^fco^f^frtg TSfe &&&s. If this (trie 
address is properly read, It is tfStSirftftied that the 

25 data dots themselves t^fbr^ the flne Address are 
property read: if M & detellttf^ed tfcS the line , ad- 
dress is not properly ^ the scanning position & 
shifted by otvi dot, for ffi&ftpfe. tb the right aid 
the second scanrtihg dpipVatKSh is performed (in- 

30 dicated by the Wxk Cirdl^s fiii R& 200). After data 
is read Up to the ^4 dote, ft is chefeked ta the sartte 
m^neris des&tSed igftove whethbr £ line address 
is ^ctu^lly raid; if it detaiWiirteit (hat a Iftfe 
address is not property the &&htffcg position 

35 at the first dot & shifted ^y one dcrt d6w^wa!*tf ( bid 
thS thlfd scanning operation is £fcrfctffted, If it te 
also determTned 0kt ^ts operafioh ftat a tine 
address is nfii frep&ty r^ad, the scanning p6sltion 
is shifted by qfte dot to the fi^ht &td me fourth 

40 scanning operation ts perfbfrft£& 

If sdannfng^of one tfha Is repeated four times in 
this mafiner, w te expected that a tlHb Address 6an 
be properly read at teeiSt 6ncfe. tf it fe determined 
that a Ifne address prbporfy te&t. the dkta is 

45 written ih the <&U meiftfery section 

In this case, the fine addfe^s of ihe rel'd line is 
"(T (slSft a^df^$), Ik, ft A dliehhiried fh& the 
line is th<£ fii$ Uho, f he preceiiiri^ ddfa rs deter- 
mined as the btcfek Md^&ss 572A and the error 

so correction data 272S. tiqte that a b&bk address 
erfor ddfectiSri cbd6, k ^Q, m&y 68 to 
the efrror correiJtioft d^ta g7£S, or e^i error cortec- 
tiort code mSy Ssb 6o a3d6d thereto defending dri 
a purpose, thereby using the ert#r correction ddia 

65 272B as an error correction cpde for a block Si- 
dr^s & a ftfeed^got6m(??i Sfsmen ih6 first 
adHress line is r^ktoiiSd. the btbdc address 
272ft is r6ad first, arfd the drdlrt&l number of the 
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corresponding block is determined from this ad- 
dress data. From the subsequent lines, actual data 
appear. Therefore, these data are read and written 
in blocks, of the data memory section 234, cor- 
responding to the read blocks. 

In the above description, if the absence of an 
error is determined while one line is scanned, the 
next line is scanned. However, scanning may be 
repeated four times per line. In this case, the 
absence of an error is determined a plurality of 
number of times. However, no problem is posed 
because the same data is written at the same 
address. When the processing is to be simplified, 
scanning is repeated four times. In addition, when 
priority is to be given to speed, the former scan- 
ning method is employed. 

The actual arrangements of the block address 
detection section 228 and the block address error 
detection/correction section 230 for realizing the 
operation of the above adjusting section 192 will be 
described with reference to FIG. 21. 

Upon receiving 10 bits of binary interpolated 
data on a shift register 190A, the demodulating 
section 190 converts the data into 8-bit data by 
using a look-up table (LUT) 190B. 

In the data, stfing a0ji^stifig section 192, this 
demodulated data js temporarily stored in a buffer 
memory (all data corresponding to 64 dots are 
input) 282 under the control of a write address 
control section 280. Of the stored data, only line 
address information and CRC information for an 
address are read out by a data read address con- 
trol section 284, and error detection is performed 
by a line address error detection circuit 286. if a 
determination signal representing this error detec- 
tion result becomes true, i-e.. the absence of an 
error is determined, the data read address control 
section 284 reads out information before the line 
address information, Le., actual data information, 
from the buffer, memory 282. 

Meanwhile, a start address detection circuit 
288 checks whether the tine address which has 
undergone error detection in the line address error 
detection circuit 286 is a start address. If a start 
address is detected, the start address detection 
circuit 288 informs a block address detection circuit 
290 that the corresponding line, is a line having a 
block address. In response to this information, the 
block address detection circuit 290 detects a block 
address from the data read out from the buffer 
memory 282. An error detection circuit 292 then 
performs error detection and correction. The resul- 
tant data is latched, as a block address, in the 
address control section 232 for the data memory 
section 234. 

Note that only error detection is added to a line 
address to obtain an accurate read position. How- 
ever, an error correction code is added to a block 


address because it is used as address information. 

Since the subsequent lines are sequential data 
lines, read data are written, as data, in the data 
memory section 234. At this time, line addresses 
5 are output together depending on processing, as 
needed. If a counter is incorporated in this arrange- 
ment, a method of automatically counting up line 
addresses in the arrangement may be employed. 
The next block is recognized when the next 
io start address "0" is detected, and the same opera- 
tion as described above is repeatedly performed 
with respect to all blocks. 

A determination signal output from the line 
address error detection circuit 286 is supplied to 
is the address control section 220 for the image 
memory 214. This signal is required to shift the 
scanning position to the next line, when data be- 
comes true, so as to shorten the time in performing 
a scanning operation four times per line. 
20 In the above case, the line address error detec- 

tion circuit 286 performs address detection with 
respect to interpolated data by using the same 
address information for four scanning operations 
until the data becomes true. When the data be- 
25 comes true, an address corresponding to a data 
line of dots , next to a new line is temporarily set to 
form interpolated data. Thereafter, the data is read 
out for every four points at a time. In order to 
perform such control, a determination signal is sup- 
30 plied to the address control section 220 for the 
image memory 214. With this operation, the same 
address is generated four times to perform inter- 
polation, or a read operation is performed while the 
order of interpolation is changed. Alternatively, the 
35 address is rewritten to an address corresponding to 
the next line, and data on the corresponding line is 
read out and interpolated to be read out four times. 

Although not shown, the address control sec- 
tion 232 for the data memory section 234 performs 
40 mapping in the data memory section 234. In addi- 
tion, in a read operation, the address control sec- 
tion 232 performs control for de-interleave process- 
ing. This operation is also performed by using a 
look-up table and the like. When, for example, 
45 addresses are generated in units of dots, the cor- 
responding data is converted into a memory data 
string actually output from a look-up table by using 
a ROM or the like on the basis of data obtained by 
combining the corresponding block, line, and dot 
so address. This operation is de-interleave processing 
(de-shuffling). Only when this processing is per- 
formed, data is read out as a data string. As a 
matter of course, this de-interleave processing may 
be performed while data is read out from the data 
65 memory section 234. Alternatively, in a write opera- 
tion, after such conversion may be temporarily 
performed to disperse the data in such an order, 
the data is sequentially written (mapped). 
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In this case, each marker 274 has a linear 
shape. However, each marker may have a circular 
or rectangular shape, as shown In FIG. 16. Once a 
marker fe detected, a read operation is performed 
along the lines In the bidckl Therefore, a mafker 5 
need not be linear. For example, as shown in FIGS. 
22A to circular, square, and rectangular mark- 
ers 294, 296, and 206 aire conceivable. 

If a printed code is fr6e from partial blur and an 
offset and almost accurate, since (approximate 10 
center «= accurate center), accurate center detec- 
tion (to be described later) may be omitted, and 
marker detection may be performed by ehly ap- 
proximate bertter detection processing^ be de- 
scribed later), in this case, however, in order to 75 
detect an afTa^ direction, dots 294A, £96A, and 
298A for array direction detection are arranged 
near the marker portions, respectively. 

FIG. 23 shows another form of the multimedia 
information reproducing apparatus. In this appfara* 20 
tus, the A/D conversion section 210 in the detection 
section 164 is moved to the scan conversion sec- 
tion 186, and the functions of the block address 
detection section 228 and the block address error 
detection/correction section 230 in the data string 25 
adjusting section 192 are realized in the scan con- 
version section 166. Since the arrangements of the 
data error correction section 194 and the subse- 
quent components are the same as those in FIG. 
17, a description thereof will be omitted. 30 

That is, the greatest difference between the 
arrangement shown in FIG. 23 and tHdt shown in 
FIG. 17 is in the scan oSfiVefSion section 186 and 
the data string adjusting section 192. In this em- 
bodiment the function of the data string adjusting 35 
section 192 is realized by simultaneously perftSrrn- 
ing the operations of components, in the scan 
conversion section 186, rahgfng from the sharker 
detection section 216 to the address control sec- 
tion 220. That is, a marker is detected by the 40 
marker detection section 2f16, and a data Array 
direction, i.e., an inclination, a rotation, and a direc- 
tion, is detected by the data array direction detec- 
tion section 218. In a block address detectbrVeirdf 
determination/accurate center detection sedtion 45 
300, a block address is detected, error detection 
therefor is performed, arid a correct center, i.e.. a 
true center, is detected depending on whether the 
block address is wro% In thts ca&, the block 
address is detected in detectihg the true center. 50 
For this reason, after the marker and the btofek 
address are interpolated by a marker/block addresfe 
interpolation section 302, the information oh the 
block address is also supplied to the address con- 
trol section 232 for the data rrremory section £34. 55 

As in the arrangement stidWri in RG. 17, ad- 
dress control is performed by the address dontr&l 
section 220 on the basis of the data obtained 


interpolating the btotik address, thereby performing 
address, write, and output oohtrol wfth respect to 
the image memory $14. 

Other arrangements are functionally the same 
as those shtfwhln RG. *t7. 

Referring to FL$S. ffc and £3, in the detection 
section 194, data is converted into, e.g., 8-bit multi- 
value digital data by the A/& conversion section 
210, and processing is performed afterward. Haw- 
ever, the fcl riar&atidn processing section (compara- 
tor) 168 and the threshold value determination cir- 
cuit 226 may be ari^ng^d in place of the A/D 
conversion section 210 to perform all the subse- 
quent processing by using binary data. 

fn this case, the interpolation circuit 222 can 
use pixel data nearest (Adjacent) to an interpolated 
address coordinates as data instead of performing 
so-cafled interpolation processing for interpolation 
of 4 or 16 points by using pixel data around the 
interpolated address coordinates obtained by the 
address control section 230, as Shown in FIG. 5. 

By performing pr^ees^ing upon binartzation in- 
stead of A/D conversion, the Viurht/er of Signal lines 
and the data amount are reduced to 1/8 as com- 
pared with the case of, ^g., eight bits. Therefore, 
the memory capacity is rf dufced to 1/8, the circuit 
size, the processing amount can be greatly re- 
duced, and the processing time can be greatly 
shortened- This contributes to a reduction in the 
size and cost Of the apparatus, and the processing 
speed can be increased. 

In trie cases shown in FIGS. 17 and 23, an 
address dutp&t f r$ft the address control section 
220 tiecornes p&el addressed Of four points around 
an interpolated address ^coordinates when image 
data Is output to the interpolation circuit 222, and 
becomes distance information witti respect to the 
interpolation circuit 222 which is used to cafeuft&4 
weighting coeffjcieht fdr e?feft pixel addre^lftrotigh 
a Signal lirte (not shown). Alternatively, each pixel 
address and ihterpdiSted address coordinate data 
m&y be sent to the interpolation circuit 322 to 
obtain the distance to each riixel address so 6s to 
obtain a wei^hfifig coefficient. 

When processing u^ng binary data is per- 
formed in the above manner, the address control 
section 220 outputs a pixel addre^ hear tfte inter- 
polated address c^brdirialfes. in tHife case, tfidfe- 
fore, the djata output from the fma^b memory 214 
is input td the demodufatihg Section 190. 

A practical ex^rnr5!e 6) tffe d5t code showh in 
RQ. 16 will be described beldw wfth rsterSnife to 
FIGS. 24A to £4D. 

As is apparent from FIG. 16 as well, blocks 304 
are tWcKltmensioftafJy airefhged, and block address- 
es 806 are respectively im&& to the bfetfte 304- 
An Slffiiftss corresponding to X and Y addresses 
added tb Sach block attartSSs AsSume. for 
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example, that the block address of the block at the 
upper leftmost position in FIG. 24A is represented 
by (X address.Y address) = (1 t 1). The block ad- 
dress of the block located on the right side of the 
above block is (2,1). Similarly, the block addresses 5 
306 are respectively added to all the blocks 304 
with the X address being incremented rightward 
and the Y address being incremented downward. 

Assume that the lowermost and rightmost 
markers are dummy markers 308. That is, the 10 
block 304 corresponding to a given marker 310 is 
lower right data enclosed with four markers 310 
including the given marker, and the lowermost and 
rightmost markers are auxiliary markers, i.e., the 
dummy markers 308, arranged to define blocks 75 
corresponding to the second markers from the bot- 
tom and rightmost side. 

The contents of the block 304 will be described 
next. As shown in FIG. 24B, the block address 306 
and an error detection code 312 are added to the 20 
marker 310 of the block 304 at a position between 
the marker 310 and the marker located therebelow. 
Similarly, the block address 306 and the error 
detection code 312 are added to the marker 310 at 
a position between the marker 310 and the marker 25 
located on the right side thereof. Referring to FIG. 
16, a marker is located at an upper, left position in 
a block, and a block address is located at a lower 
light position in the block. In this embodiment, the 
block addresses 306 are located on the left and 30 
upper sides of a block, and the marker 310 is 
located at the upper left comer of the block. Al- 
though the block addresses 306 are recorded at 
two positions in one block in this case, these 
addresses may be recorded at one position. How- 35 
ever, block addresses are preferably recorded at 
two positions because even if an error is caused by 
noise in one block address, an address can be 
reliably detected by detecting the other address. 

The positions of block data relative to markers, 40 
the position of the corresponding block addresses, 
the positions of dummy markers on codes which 
are determined by the positions of the block ad- 
dresses, and the like are not limited to those de- 
scribed above. 45 

A pattern of the marker 310 will be described 
next As shown in FIG. 24C, in this embodiment, a 
pattern 31 OA of a black circle having a diameter 
corresponding to seven dots is used as the marker 
310. A white portion 31 0B is arranged around the so 
black circle 31 OA to facilitate discrimination of the 
black portion of the marker. Reference numeral 
310C in FIG. 24C denotes an auxiliary line used to 
explain the marker. 

The range of the white portion 31 0B is prefer- 55 
ably minimized to increase the recording density, 
but is preferably maximized to easily and quickly 
perform marker detection processing. For this rea- 


son, the range 31 OC for allowing the pattern 31 OA 
to be sufficiently discriminated when the rotational 
angle is 45* is set within the portion 31 0B. 

The magnification of the image formation op- 
tical system 200 In FIGS: 17 and 23 is set such 
that the size of a data dot 316 in a data area 314 
becomes a value corresponding to 1 .5 pixels under 
the condition to be described later. In this case, a 
pixel means one pixel of the image pickup element 
of the image pickup section 204. That is, one dot, 
e.g., a dot having a dot size of 30 to 40 urn, 
recorded on the sheet 182 is focused into a dot 
having a dot size corresponding to 1.5 pixels, on 
the image pickup element, each of which generally 
has a size of 7 or 10 am, through an image 
formation system lens. According to the sampling 
theorem, the pixel pitch may be set to be smaller 
than the dot pitch. In this case, for a reliable 
operation, the pixel pitch will be set to be 1.5 
pixels. Note that in the above case wherein 
binarization is employed instead of A/D conversion, 
the pixel pitch is set to be two pixels for the sake 
of a more, reliable operation. 

By employing the above two-dimensional block 
division scheme, the following advantages can be 
obtained: 

If the dot pitch of dots is below the resolution 
of an image pickup element, a code (a set of unit 
data blocks) can be read even with a change in 
data dot size; 

Even if the image pickup section 204 is in- 
clined with respect to a code, the code can be 
read; 

Even if a sheet locally decom- 
presses/contracts, a reproducing operation can be 
performed. Even if a sheet is rotated, a read opera- 
tion can be performed; 

Unit blocks can be two-dimensionafly arranged 
freely in accordance with a total data amount As a 
result the code size can be freely changed; 

Since a block address is added to each block, 
a reproducing operation can be performed even if a 
read operation is started from an intermediate por- 
tion of a code; 

The shape of a code can be arbitrarily ar- 
ranged in units of blocks in accordance with, e-g., 
characters, pictures, and graphs. FIG. 24A shows a 
rectangular dot code. However, a dot code may 
have a hook-like shape or slightly deformed; and 

Neither a predetermined start code nor a pre- 
determined stop code as in a bar code is required, 
and no clock code is required. 

Owing to these characteristic features, a re- 
producing operation can be performed regardless 
of a shake of a hand of the user. Therefore, the 
present invention can be easily applied to a handy 
reproducing apparatus. 


20 


37 


EP 0 670 555 A1 


38 


Although a detailed description is omitted, four 
adjacent markers are detected oil the reproducing 
apparatus side to divide thd portion between the 
markers into equal parts 6qual In number to the 
number of dote. ThetgfWe, the: apparatus is ca- 
pable of effectively eStfitftie enlargerri&iH, reduc- 
tion, deformation, 6hd flte HKG arid Is tfeslsfeht ft a 
shake of a hand of tfid tisSt. 

With regard to tf& data dot 316 in the data 
area 314, eftd dot has a ifl« df several tens itin. 
This size can be reduced ifcr a level of several urn 
depending dn an ap^lfeafion 6r us©. In genera, 
however, the glie is 4& 20; or 80 urn. The dtfe 
ar6a 314 has a size^of. 64 x 64 dots. TtfeSfc 
sizes oan be Increased Or decreased within a rati|^ 
in which air error dtte to the stBJ5v& &}uaJ divisIW 
scheme can be abSortfed. In addition, the above 
marker 310 has not erfty the function of a sync 
signal but also the function of a position ihdex. Thfe 
ma&er has a size different frohn that of m#cluiated 
data, in this example, f6t example, the marker has 
a circular shape and a sffce of seven dots or more, 
each Identical to a dot in the data area 314, dr the 

* cfrcular black marker 3t0A Having a diameter cbr- 
^ responding to abouf 7 x 7 ddte is u§8d. 

' An ih^inatfon, a rotation, and the likb in a 
^ reproducing operatioh ft it) be described below. 
>■ The inclination of the Image pickup section 204 
■* indicates a state wherein the user h61d6 the re- 
producing api&fatus obliquely, which sh'duld be 

• held to be peTpehtilcufar to the shedt 18£ cm which 
a dot code is printed and the a&Sar&as Is held 

T obliquely with nespbtft to the isheet iffe. fHS rota- 
tion of the ime^ pickt/p Section 684 indicated a 
state wherelh the Irt^gtng area (see RG. 4A) is not 
parallel to th£ dot cdde written on the sheet 1^2. 

When the above fociinafion occurs, an image 
obtained by the image pickup section 204 is srhajf- 
er in size th&n an image obtained when the image 
pickup section 204 is perpendicular to the Sheet, if, 
for example, the Irhage pickup seetfSh 204 is in- 
dined at 30* , an apparent projected image is 
reduced to 66.5%. That is, if, for example, the 
image pickup section 204 is inclined at 30 * In the 
horizohtal direction With respect to the vertical di- 
rection when a block is square, a block image is 
0.665 times tfiat otrtSihed without fcny Ihclinsftiori fh 
tffe horizontal dtr^dtloh evtfn fiibugh the We in thfc 
vertical direction rdm&Shs tfie same. The re$uft£ht 
blodfc image is rectangular. With such an incliha- 
tion, if ffie apparatus has a cfdck for frft&irhal syn- 
chronlzatloh, since the respective cbmpoftents am 
operated by equal-interval clocks, the resurtJJfit dd& 
may not cotncide Wffh Intrinsic itdta. 

If a rotation is conlitfered only in terms of 
horizoritSl afiU vertical directions, true d&t£7s ob- 
liquely Shifted u£M&fd or dbwrrward. As a result, 
true InformatfSn cannot be obtained, tfi additi6h, if a 


complex state of irrclfrtetion and rotation occurs, an 
image of a ^que&'e blddk becomes a rhombus as an 
imagflrfg result. Therefore, the condition that hori- 
zontal and vertical data arrays are perpendicular 
6 canrtotb& satisfied. 

The nmHOT a&teotlon section 216 for solving 
th£& problems Will be described below. As shown 
in FIG: 25, the mSaftter detection section 216 is 
constituted by a maimer determination section 318 

to for extracting a mafK^r frpm a- code and determinr 
ing it a marker 3F6a detection section 320 for 
detecting art atea in which the markdr Is present, 
ancl ah approximate ceVi^r 4et$ctioft section 322 
for deteetlhg ah t&$0rmm&e <^nfer of the marker. 

?5 The marker de^rmJnation sSfction ^18 search- 
es for 7 of Mbfd em f& br l^^cte^ecdflvS blatfk 
pixels. If such cdhsectitive bladk pixels continue for 
seven lines, the m^ker detemiutatlon section 318 
recognizes the pixels as the circular black marker 

20 31 OA. As shown fin RG. 26, first of all, the marker 
determination section 318 teinfcrlzes image data 
read out ft&m tiifc image memory 214, arid Iden- 
tifies each plx&i as a black or white pixel (step 
S32). The marker determination section 318 de- 

25 tects consecutive bl^ck pixelfe ih the X-axis direc- 
tion in the image ni#m6r^ 214 (step S34). That is, 
the marker dfetermlnatioh section 3f8 detebts 7 or 
more and 13 bf less consecutive black pixels: The 
mafker dbterrriih^tittfi sfetctidh 318 thein checks 

30 whether a pixel stiHted from the middle pixel be- 
twe^n this fif8t and Cast bfa6k pixels Of the consecu- 
tive pixels ih tfib V^fe tilre(S1on by one pixer te a 
btaak j5fi^V(step ^36)/lf m ooritihues sWen tfmds 
in tile Y-dxIs dTredfcdh (Step 838). the marker d^ter- 

35 mination section 318 determines that the corre- 
sponding fjbcbls are the eircular black marker 310A 
(step 840)- If hp cofis&iSufive blade pixels -are d6- 
t^cted In step S34 O? it is d^fefrWin^d trt Step 836 
that the pixel is not a biadk pixel, the marker 

40 determination section 318 d<&s not determine the 
coifesponding pixels as a martcer (step 

Assume th^tt the maifeer deternifnaitioti sectidn 
318 checked mlre&fe in the ima^e memory and 
found a line having &vW consecutive 6ladk p&8t£. 

45 In this case, the marker determination sectidn 318 
checks whetfier a point shifted trbm the middle 
point ft&twegfi thfe first and last black pixels of the 
consecutivfe bfack 0tx0ls in the Y-axi^ direction by 
one pix§l is a 6'laCK pixel. H it is a black pixel, the 

so maftcer deterrhiftifi^N Section 318 checks Wh^Hier 7 
to f 3 boHsgdtifivg $S^k pvtm ofi fte left dnd right 
sldb df the bladk pWel dra b!a6k pixels, the maiKer 
detefmiftafioA sSdfkW $te ! petfofms a similar opefa- 
tion Wffile ^htftffTg m pedm p\i&\ by pixel In the 

65 axis direSlott. if 4&$ d^fation is repeiSbd seven 
times in fhb Y<&is dif&fedh finally, the c^Vms!p6rtd- 
ing portirih is ddt&fifiified as die dr&lar bladk 
marker 31 OA. 
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Note that "7" as the minimum value for check- 
ing consecutive black pixels in the X- and Y-axis 
directions is a value for discriminating/determining 
the black portion (circular black marker 31 OA) of 
the marker 310 from modulated data. More specifi- 
cally, this value is the lower limit value set to 
discriminate the data area 314 from the circular 
black marker 31 OA regardless of contraction or 
inclination of the paper sheet. "13" as the maxi- 
mum value is the upper limit value set in consider- 
ation of decompression of the paper sheet, an ink 
blur, and the like. This value serves to prevent 
noise such as dust or a flaw larger than a marker 
from being erroneously detected as a marker. 

In addition, since a marker pattern 30A is cir- 
cular, no consideration need be given to a rotation. 
Therefore, the difference between the lower and 
upper limit values can be minimized, thereby re- 
ducing the frequency of erroneous detection of 
markers. 

The range of the circular black marker 31 OA 
determined by the marker determination section 
318 is slightly decompressed/contracted or de- 
formed because of an inclination, a change in im- 
age magnification, and the like. Therefore, the 
marker area detection section 320 serves to detect 
a specific area in which the black range is located. 

As shown in FIG. 27, first of all. the marker 
area detection section 320 detects a temporary 
central pixel , of the circular black marker 31 OA 
determined by the marker determination section 
318 (step S52). That is, one pixel near the center of 
the range determined, by the marker determination 
section 318 is detected as a temporary central 
pixel. 

The marker area detection section 320 checks 
the presence . of a black pixel upward (the minus 
direction on the Y axis) from the temporary central 
pixel. If a white pixel is detected, the marker area 
detection section 320 checks a few pixels on the 
left and right sides of the white pixel. If a black 
pixel is detected, the marker area detection section 
320 checks pixels upward in the same manner as 
described above up to a Y address at which no 
black pixel is present. Then, if a black pixel is not 
detected, the marker area detection section 320 
sets the Y address in a Ymin register (see FIG. 
28A) (step S54). Similarly, the marker area detec- 
tion section 320 checks the presence of a black 
pixel downward (in the plus direction on the Y axis) 
from the temporary central pixel, (f a white pixel is 
detected, the marker area detection section 320 
checks a few pixels on the left and right sides of 
the white pixel. If a black pixel is detected, the 
marker area detection section 320 checks pixels 
downward in the same manner as described above 
up to a Y address at which no black pixel is 
present Then, if a black pixel is not detected, the 


marker area detection section 320 sets the Y ad- 
dress in a Ymax register (step S56). 

Subsequently, the marker area detection sec- 
tion 320 checks the presence of a black pixel 
6 leftward (in the minus direction on the X axis) from 
the temporary central pixel. If a white pixel is 
detected, the marker area detection section 320 
checks whether a few pixels on the upper and 
lower sides of the white pixel are black pixels. If 
70 they are black pixels, the marker area detection 
section 320 checks pixels leftward in the same 
manner as described above up to an X address at 
which no black pixel is present. Then, if a black 
pixel is not detected, the marker area detection 
75 section 320 sets the X address in an Xmin register 
(step S58). Similarly, the marker area detection 
section 320 checks the presence of a black pixel 
rightward (the plus direction on the X axis) from the 
temporary central pixel. If a white pixel is detected, 
20 the marker area detection section 320 checks a few 
pixels on the upper and lower sides of the white 
pixel. If a black pixel is detected, the marker area 
detection section 320 checks pixels rightward in 
the same manner as described above up to an X 
25 address at which no black pixel is present. Then, if 
a black pixel is not detected, the marker area 
detection section 320 sets the X address in an 
Xmax register (step S60). 

A marker area 324 is selected by using the 
30 values of the Xmin, Xmax, Ymin, and Ymax regis- 
ters which are obtained in the above manner, as 
indicated by the table shown in FIG. 28B (step 
S62). That is, instead of the square range including 
the circular black marker 31 OA, the hatched area in 
35 FIG. 28A, obtained by omitting the comer portions 
of the range, is selected as the marker area 324. 
The marker area 324 may be rectangular. In prac- 
tice, however, data is present around the white 
portion 31 0B of the marker 310. This data may be 
40 influenced by a spatial filter, and information or the 
like of the black data portion may enter the white 
portion 31 0B to enter the marker area 324 for 
calculating an approximate center. In order to pre- 
vent this, it is preferable that the marker area 324 
4s be a minimum necessary range. In this case, an 
area which has the same shape as that of the 
circular black marker 31 OA, i.e., a circular shape, 
and is larger than the circular black marker 31 OA 
may be set In this embodiment, however, since 
so the circular black marker 31 OA is a small circle 
having a diameter corresponding to seven dots, the 
marker area 324 has a shape like the one shown in 
FIG. 28A. 

The approximate center detection section 322 
55 serves to find the approximate center of a marker 
in a marker area detected by the marker area 
detection section 320 in this manner. In printing or 
the like, a dot is generally decompressed to have a 
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size larger than an tntend&d size (this phenomenon 
is called dot gain) because of decompression of 
the ink or contracted to have a size snteller than 
the intended size (this phenomenon is called dot 
reduction), in addition, tha ink may spread or soak 5 
in one side. As ccmntermeMfeures against such dot 
gain, dot reduction, arid soaking erf an ink, th6 
approximate center detection secfibn 322 obtains 
the center, i.e., the center of gravity, of an image of 
the circular black marker 310A, and sets it a§ an 10 
approximate center. In this case, this processing is 
performed to obtain ihe above center with a preci- 
sion corresponding to a value Smaller th&n one 
pixel pitch. 

First of all, the marker area 324 on the image is 
is divided into two portions tn the X- and Y-axis 
directions in the image memory 214, and the cen- 
tral lines of the respective portions on ffie X and Y 
axes are detected, thereby obtaining a final center, 
i.e., an approximate center. FIQS. 28C and 28D 20 
respectively show the cumulative values of the 
respective pixels in FIG. 28A fin the vertical and 
horizontal directions. The center of gravity cor- 
responds to a position of 1/2 the total cumulative 
value, i.e. ( a portion where the vertical and Wori±8h- 25 
tai cumulative values become equal to each other. 

Referring to FIG. 28C, assume that result 
Sxt obtained by addth(j the respective cumulative 
values of the hatched portion in FfG. 28C Is lets 
than 1/2 a total area S, and 6 valufc obtained by 30 
adding a next portion Sxc to ihe result Sxl Ex- 
ceeds 1/2 tffe total area. In mis £a^. ft can be 
determined ffiat a central linfe X SndudiWg ah aj> 
proximate center is Mduded fh 0\$ dfrSy Sxc. That 
is, with regard to the X address of the approximate ss 
center, when a value obtained by tfefcumuldMg me 
cumulative values of the respective arrays pflc) 
frdfn the left dde (in the Xmfh direction) to the QC 
+ l)th array exceeds 1/2 the total cumulative val- 
ue, me approximate center is present betweeti the 40 
Xth array and the (X" + 1)m array. If the QC + 1)* 
ttr array is divided into left and right portions such 
mat a value obtained by adding me lift of fight 
portion to me cumulative value of X* arrays be- 
comes 1/2 me tdta) arfea, the division lirte Includes 45 
me approximate cerrteT. 

The ratio of a portion obtained by subtracting 
the cumulative value of the X arteys from 1/2 the 
total area, i.e., (1/2)S - Sxl to the cumulative value 
Sxc of the rriiddfe array is represented by A x 50 
(approximate cbflfer = )C + Ax). 

This operation will be desdrfbed beldw with 
reference to tfca Wow chart in fHQ. 29. 

First of all, normalization is performed (step 
S72). More specifically, data hi tha fmag^ memory 55 
214 is normalized as data having fjf&dattion of 
multi-value data by setfirtg 6 frhfte daf£ poW6h to 
be "0". and blade data, fbr exarhpfe, "1*, so as hot 


to Influence accumulation even if peripheral por- 
tons are added with respect to the respective data 
of me marker 324. Since the peripheral por- 
tions are blurted by a spati& filter ami thb like, mis 
operatfdn fe peifontiistj to accurately recognize 
such a state so as to accurately detect me center 
of gravity. 8uT3$$quently, a cumulative vatQ^ Sk of 

eadtT afr^ KR (ft e flffifr. ttm- + 1 max) is 

obtained fti&p €74)/ and a center^£gravity cal- 
culatiofi subroutine te' called (step 876). 

In the center-ef^Qfayity calculation subroutine, 
as shown 4n RG ^0, $a total arfca S is obtefihed, 
1/2 the total draSr IS represented by Sh, and Si is 
set to be 0 (step 89®. A >Jaiue is set from me 
leftinost etftey, I * min (step 694), and %V « 
St = SI is d^l^ted (stfep S396). Slri£§ St = 0 at 
first SI Si, and Sr * Smlh. Subsequently, Sl f 
is compared wffh Sh. i.e., Tffi me total area (step 
S98). If SV jdoes riot exceed Sh, i is incremented 
(step S1O0), and Si 9 is s^t to Si (step S102). The 
p&oessthg is repeated ft&m step S96 described 
abovb, thereby accumulating me next array. When 
the accumulation Result eicCeeds 1/2 the total area, 
Si is subtracted fnM S/2, and the resultant value 
is divided by 6i, faefeb? obtaining A x fstep S104). 
A valii& dbt&itteQ by ffl&ad A x to i, i.e.. >C is 
represented by G (step Si OS), and the flow returns 
to M mSh routine. 

In the main routine, the value of C is set as the 
X-coordinate otfthe afJprdximife center (step S78). 

Similar processing is performed in each row 
direction in st&ps 680 to 684 to obtain me Y- 
cdordinate, and )i and Y are %et as values indicat- 
ing th& ap^xfM&te ceqter of the marker (step 
S86). 

FIG. 31 shows an arrangement for realizing 
such processing. 

A normalization circuit 826 performs normaliza- 
tion while setting white data as "0°; and&tack data, 
"1". Outputs from the normalisation circuit 326 fro 
accumulated by ah accumulation section 328 to 
calculate me tqtal area Si Ttfe cumulative value is 
multiplied by 172 by a 1/2 multiplying section 330 
and latched ifi a latch circuit 332. 

Meanwhile. th$ outputs from me normalization 
circuit 326 whfeh ^g^Sp^d to blocks in me X*ax!s 
direction are by d^l^y eirfcutts $34 and 

33B, and the r^rd^jve ffifeys are setjuerittafty 
accumulated from the teft sidb by an accufftuiartfcn 
section 338, and aCfeumtfl^idn is f&rformed irt units 
of arrays by ah decurrfut^tion se6tidn 340. When 
me result Is to be output, a portion of a central 
array SS6c is d^th. 

A comparator 342 compares me 1/2 area 
latched In the fetch circuit 832 wfth me cumulative 
vMe of the r^spfecfiv^ iirf^ys a66umutated by #16 
acCumulSfi&n sectlort 336. A latch 344 sers^s to 
stofe a detdrftil^^tion timing and me accumulation 
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of preceding arrays. When the comparator 342 
determines that the cumulative value exceeds the 
1/2 area, an X address calculation section 346 
calculates the X address of the final approximate 
center of the marker from the 1/2 area latched in 5 
the latch circuit 332. Sxl latched in the latch 344, a 
cumulative value Sxc from the accumulation sec- 
tion 340, an address corresponding to the above 
value X* supplied from the address control section 
220 through a delay circuit 348. 10 

Similarly, the Y address of the approximate 
center of the marker is calculated by using delay 
circuits 350 and 352, accumulation sections 354 
and 356, a comparator 358, a latch 360, and a Y 
address calculation section 362. Note that in this 75 
case, the delay circuits 350 and 352 are con- 
stituted by line memories. 

In this case, the delay circuits 334. 336, 350, 
and 352 are circuits for adjusting the output timings 
of S/2. Sxl, Sxc, Syi, and Syc to the required 20 
timings of the X and Y address calculation sections 
346 and 362. 

The data array direction detection section 218 
will be described next. For the sake of descriptive 
convenience, the arrangement of the respective 25 
blocks 304 of the dot code will be described in 
detail first The blocks 304 of the dot code are 
arranged as shown in FIG. 24B. FIG. 32 shows the 
arrangement in more detail. That is, the block ad- 
dress 306 can be divided into an upper address 30 
code 306A and a lower address code 306B. The 
error detection code 312 can also be divided into 
an upper address CRC code 31 2A and a lower 
address CRC code 31 2B. The lower address code 
306B is arranged on a side of the marker 310, and 35 
the upper address code 306A larger than the lower 
address code 306B is arranged on its side. The 
upper address CRC code 31 2A having the same 
size as that of the upper address code 306A is 
added thereto. Furthermore, the lower address 40 
CRC code 31 2B having the same size as that of 
the lower address code 306B is added to the upper 
address CRC code 31 2A. 

A block address and error detection data are 
also arranged under the marker 310 toward the 45 
lower marker in the order described above. 

In this case, a combination of the upper ad- 
dress code 306A and the upper address CRC code 
31 2A will be referred to as a step 1 code; and a 
combination of the lower address code 306B and so 
the lower address CRC code 31 2B, a step 2 code. 

In addition, the lower address code 306B can 
be decomposed as follows. On the right side of the 
marker 310, codes inverted with respect to the data 
of each of dots representing lower address data are 55 
written on the upper and lower sides of the data 
(on the left and right sides of the data of the code 
under the marker 310). In addition, data marginal 


portions 364 are arranged to discriminate the code 
from the upper and lower data areas 314. Note that 
these data marginal portions 364 may be omitted. 
Inverted codes are added to not only a lower 
address code but also an upper address code. In 
this case, for easy understanding of data, each dot 
is indicated by a circle. In practice, however, a 
white circle indicates the absence of a dot to be 
printed. That is, no white circle can be printed. 
Each white circle in the subsequent drawings in- 
dicates the same. 

In this case, upper and lower addresses are set 
such that when, for example, the entire address 
consists of 12 bits, the first 4 bits are assigned to 
the upper address, and the next 8 bits are as- 
signed to the lower address. The data lengths of 
such addresses can be changed in accordance 
with an apparatus, as needed. An entire block 
address is basically designed such that the first bit 
to a specific bit are assigned to an upper address, 
and the subsequent bit to the last bit are assigned 
to a lower address. 

As described above, address codes are ar- 
ranged in the horizontal and vertical directions. 
With this arrangement, even if address code detec- 
tion in one direction fails, the other address code 
can be detected. 

The arrangement of another dot code will be 
described with reference to FIG. 33. FIG. 33 shows 
a dot code from which the address codes in the 
vertical direction in FIG. 32 are omitted. Since 
address codes are arranged only in one direction, 
an increase in data area and processing speed can 
be realized. Since address codes are arranged only 
in one direction, if an address code cannot be 
detected, the address of the corresponding block 
cannot be detected. However, the address can be 
obtained with address interpolation processing to 
be described later. 

Referring to FIG. 33, block address codes are 
arranged only between markers in the horizontal 
direction. However, dot codes may have block ad- 
dresses arranged only in the vertical direction. 

Alternatively, as shown in FIG. 34, an upper 
address code 306A may be arranged between low- 
er address codes 306B, and an upper address 
CRC code 31 2A may be arranged between lower 
address CRC codes 312B. 

Processing will be described below with refer- 
ence to the dot code shown in FIG. 32. Only 
processing unique to the dot code shown in FIG. 
33 will be additionally described. 

FIGS. 35 and 36 are a block diagram showing 
the arrangement of the data array direction detec- 
tion section 218 in FIG. 23 and a flow chart show- 
ing its operation. 

The data array direction detection section 218 
receives the data of the approximate center of a 
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marker from the approximate center detection sec- 
tion 322 in the marker detection section 216, and 
selects an adjacent marker in an adfcoeftt marker 
selection section 2(66. That is, the addresses of the 
cehters of the respective markers h£ve b0€r\ s 
mapped on a screen by the processing performed 
by the approximate center detection section 322. A 
representative marker to be currently processed, 
i.e., a target marker, Is selected from thes3 rn£rk- 
ers (step S112). and adjacent marker seTection is w 
performed to detect a marker Whose approximate 
center is nearest to the representative marker (step 
S114). 

As shown in HG. 37, in adjacent marker selec- 
tion processing, each distance d between the re- 75 
presentative marker and the adjacent markers is 
calculated, and adjacent markers within the range 
of d £ dmax are designated (step 3142). In this 
case, dmax represents the length of a idhger side 
of a data block + a (a is determined by de- 20 
compression/contraction of a paper Sheet), there- 
after, the approximate center addresses of the des- 
ignated adjacent barkers are supplied to a step 1 
sample address generation circuit 368 in an order 
from shorter distances d (step S144). Referring to 26 
FIG. 38A, for example, an approximate center ad- 
dress at a distance 02 from the representative 
marker is nearest thereto, afiti approximate Center 
addresses at distances Di and D4 are next nearest 
to the representative marker, and approximate cert- so 
ter addresses at distances 03 and D5 come next. 
Therefore, the approximate confer address at the 
nearest distance 02 is supplied first K apprdxfrhate 
center &dd)re&£ds are located at the same distance 
d, a marker search operation is performed ci5ck- 35 
wise from a distance calculation start address, and 
direction detection Is performed irt the order in 
which markers appear (step $146). That is, the 
approximate center addresses at the distances 01, 
04, 03, and 05 are seqUeritidliy supplied to the 40 
step 1 sample address generation circuit 368 to 
perform direction detection to be described later. 

Mbre specifically, the step 1 sample address 
generation circuit 368 generates step 1 sample 
addresses on the basis of the representative mark- 46 
er and the approximate ceriter of tfie sdte&Sd 
adjacerit marker (step 8110), and g§fierates scan- 
ning lines connecting ti&se step 1 sarnpld ad- 
dresses (step Slid). The step 1 s^rhpde address 
generation circuit 368 then generates rea3 acl- so 
dresses to sample date in the image memory 214 
at poihtt set at actual intervals on the scanning 
lines (step S120). The address control eectid* 220 
supplies the addresses at these sample points as 
read addressed to the image rnemory 2t4, titereby 65 
reading out daaa. 

According to the above description, data at a 
sample point is approximated and output (from the 


image memdry). However, as shown in FIG. 5, if it 
is deterrhin&j that a sample point is present be- 
tween data In the *mage memory, data may be 
obliged froffi Iftfe €3ta of four p&eis around the 
sample poiht fey l^r^cjtatiori- 

Affef the rata read out by this operation, i.e., 
the upper address eG9$> is subjected to error de- 
tection In an etrdf ^atfiction circuit 370, the resul- 
tant data is SMppti&ti Ip an dipper block address 
c^tM^rl drt«3^^ 372. If the 

errdf d$tSfci&Sft r^jp^t 6b^i1«& &y the error detec- 
tion circuit 37©Mridlc#tes the presence of an error, 
the upper falo&k Jfit^SSfe calculation arid center 
calcul^bn circuit §8|g^es the address calcula- 
tion result to the adjacent; mdfrker selection section 
368 to it^ perfdmtthe next adjacent marker 
selection prddessihg. If rparkers fn two directions 
are detected, the upper tJtock address calculation 
tffcd center calculation cfirsoft 372 also supplies the 
address caicufelieh result to the adjacent marker 
selection sectich S66 to cause it to finish Adjacent 
marker selection processing because any adjacent 
markers need not be detected any more. 

ff the dot code shown in HG. 33 is used, 
rriarker selection processing is finished when , the 
upper address cbd^ iri one direction are detected. 

If the presence if &h address error is indicated 
by this addrefsi cali^uiation result (step S122), it is 
determined whether sbarming all the sample points 
is completed (stefp St24)- If Scatththg is not com- 
peted, tffe flo^^idvinc^s tb step 8118. ff scanning 
is eom^TeteQ, j^r^Ace^bs6nce of a non-de- 
tected atpce6t rfiarker is checked (step 8126). If a 
non-dete#&d |@@f$&ft marker is present, the flow 
advfftc&Tto $fip Jjhi4 described above. If no such 
marker Is pre^rlt M the rharkers are processed In 
thb same marker. After processing for all the mark- 
ers IS cdmpteted, the flow advances to mark- 
er/address interpolation processing (step $128). 

Note tiiat the errdr detection cirouit 370 may 
use a general error detection scheme such as an 
error detection scheme based ori cyclic codes, 
which fs disclosed in, e.g., "Introduction to Coding 
Theory", the Journal of Television Institution, Vol. 
44, No. 11, Pft. 1549 - 16355. 

ff it is det0rmin£3 in spp $122 that no address 
error is piresefit It is deteifnihed wfieffi^r scanning 
at all thd samplb points is completed (step Si 30). If 
scariritfVg is ridt competed, the flow advances to 
step Si 1B described above. If scanning at all the 
samfile jfoirtts is completed, an upper address is 
d&ddSd (step S1S2), and a step 1 certter address 
is caJcufdted (step 6134) and decided (sfep 8136). 

A ^(recfron detection is be^un With a marker at 
the shortest distant frdm tt$ representative rhark- 
er (ft Mr. 33& 16 ^prd&rffafe center arfdres^ls 
at the dlstehce t52). According to a detection meth- 
od, sjSecific directions in which perTrjheral rnarkers 
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are present are determined depending on whether 
addresses recorded on dot codes (step 1 codes) 
for direction detection, which is larger than a data 
dot are recogniged or not. An upper block address 
and its CRC code are recorded in a step 1 code. If 5 
no error is detected in scanning the code, it is 
regarded that the code is recognized. 

When the direction is detected, the Inclination 
of the data block can be estimated. A step 1 code 
has directivity, and a block address Ms properly 10 
recognized only when scanning is performed from 
a representative marker toward a peripheral mark- 
er. If, therefore, no recognition error occurs, block 
address codes in two directions are always de- 
tected. Processing is performed until block address 75 
codes in two directions are detected. A data array 
can be estimated from the positional relationship 
between the two directions (see FIG. 38B). 

When the^dot code shown in FIG. 33 is to be 
used, address codes are detected in only one 20 
direction. In this case, a data area can be recog- 
nized from a detected line and a scanning direction 
(FIG. 39). 

In an actual operation, direction detection is 
started from the distance D2 as the shortest dis- 25 
tance from the representative marker. If no address 
is recognized, a search operation, is performed 
clockwise. Therefore, a similar operation is repeat- 
ed at the next shortest distance D1. When detec- 
tion is to be performed clockwise, detection is 30 
repeated at the distances 04, 03, and 05. Process- 
ing is performed until two directions are detected. 

In the case shown in FIG. 33, processing is 
performed until one direction is detected. 

If one direction can be detected, the other 35 
direction may be estimated. Assume that 04 and 
D5 are in the forward direction, 02 is not present 
and a searches started from D4. In this case, if an 
address is recognized at D4, it can be estimated 
that an address can be recognized at either D3 or 40 
D5. 

The above direction detection processing will 
be described in more detail below with reference to 
FIG. 40A 

The approximate center of the representative 45 
marker, which is detected by the approximate cen- 
ter detection section 322 in the marker detection 
section 216, is defined as a dot A5 on the upper 
left side in FIG. 40A, and the step 1 sample ad- 
dress generation circuit 368 generates eight sam- 50 
pie points A1 to A4 and A6 to A9, each separated 
from the dot A5 by 1.5 dots (this value can be 
changed depending on processing, as needed). 
Similarly, sample addresses are generated around 
the approximate center (a dot B5 on the upper right 55 
side in FIG. 40A) of a marker, e.g., the marker at 
the distance 02, from which direction detection is 
to be performed. 


The reason why dots are arranged at 1.5-dot 
intervals will be described below. 

In the above description, when processing for 
obtaining an approximate marker center is to be 
performed, a difference from the center is within 
one dot. In this case, however, it is assumed that 
any inconvenience such as an ink blur does not 
occur. The detection range is set to be q1.5 dots in 
consideration of an ink blur and the like. 

•The address control section 220 draws pre- 
determined lines between the addresses of two 
markers. A scanning line is drawn between dots A1 
and B1 at first. A sample clock is set to allow 
sampling of an upper address, thereby sampling 
data in the image memory 214. 

As shown in FIG. 32, the upper address CRC 
code 31 2A is added to the upper address code 
306A. For this reason, when data is properly read 
by the data sampling operation, an error detection 
result obtained by the error detection circuit 370 
with respect to the upper address indicates that no 
problem is posed. When data is not properly read, 
the presence of an error is determined. 

Similarly, scanning lines are sequentially drawn 
between the dot A1 and a dot B2, the dot A1 and a 
dot B3, and the dot A1 and a dot B4 to determine 
for each scanning line whether error detection is 
proper. Since there are nine positions on the repre- 
sentative marker side, and nine positions on the 
detection marker side, a total of 81 processes are 
performed. 

If errors are detected in all the 81 processes, it 
is determined that no direction code is present in 
the corresponding direction, i.e., the detection-side 
marker is marker other than an array (erroneously 
detected marker). 

Assume that data is sampled at each sample 
point on a scanning fine (indicated by the dotted 
line) drawn between the dot A1 and a dot B7 in 
FIG. 40 A In this case, since a sample point in- 
dicated by the broken circle in FIG. 40A is located 
outside data, a detection error occurs. Especially, 
as described above, since inverted codes are ar- 
ranged on the upper and lower sides of each data 
dot, an error always occurs. 

If a line is drawn between dots A5 and B5, 
since data is properly detected, no detection error 
occurs. Therefore, it is recognized that a code is 
present in the corresponding direction. 

Although inverted codes are arranged on the 
upper and lower sides of each data dot to facilitate 
error detection, these codes need not always be 
arranged on the upper and lower sides. For exam- 
ple, white codes may be written on the upper and 
lower sides of each address data dot, and address 
data dots may be written such that black data, 
continues by a few dots in the latter half of the 
address data dot portion. With this form, an end 
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portion on the detection marker side is always 
blade data, and white marginal portions are set 
outside the data. Therefor^, a data error can be 
property detected. In addition', inverted codes need 
not be set throughout the entire inverted ed96 
portions but may be partly set on the both ^ides 
(FIG. 41). 

the size of a dot will be described below. As 
shown in FIG. 40B, assume that the size of e&ch 
dot of the upper address dbde 3Q6A & represented 
by n dots, and the width of a step 1 code is 
represented by m dots. In this case, m and n have 
the frilldwing relationship. Widths, eactv correspond- 
ing to two dots with respect t& thfe 66nter, are s6t 
on the Inner ends of the step 1 sampfle address, 
and diagonal lin&s are drawn. Th6 height of a 
rectangle having a width rh, which is determined 
depending on how long the upper address code 
306A is set, as a long side, and diagonal lines 
coinciding with the above diagonal lines is repre- 
sented by n. That is, when m Is detefmined, n is 
inevitably determined. Even if the entire portion 
between the irtner ends of th£ step 1 sample 
address is this address code, since the width cor- 
responds to only two dots, n dots correspond to a 
width ef two dots. Although the width of a dot is not 
determined, a width allowing easy recognition of 
data is preferable. 

Note that the above two bits are defined to 
obtain a range in which a hit c£n be gained oh a 
scanning line connecting, e.g., the dots AS and B5, 
but no hit can be gained on a line cohYi^ctfng a dot 
A6 and flie dot B4 and a line CbhHetting dote A2 
and B8. Assume that a targer vafud is defindd as 
the number of dots. In tills case, If, for example, a 
hit is gained on a line connecting tWe dots A5 and 
B5. a hit is also gaihed oh a One connecting the 
dote A£ and B8. As a result, the detection &hge of 
a center is widened. This value can also be 
changed in accordance with ah apparatus. 

In the case shown in FIG. 40A, a hit is gained 
on a fine connecting the dots A5 and B5. If, how- 
ever, a hit li also gained on a line cdrmefcting a dot 
A4 and the dot B5. the center betwdbn the dots A4 
and AS is set as a start point in the tfage of tiie 
st§p 2 of center detection, arid a search operation 
is performed on the baSs of the ceffte'r ffi flie sffifiS 
manner as described above. 

Another method is also conceivable. This 
method will be described with reference to FIG. 42. 
In this cash, ff hits are gained on rid* only a line 
connecting dots A4 and A5 but alsb a fifte Connect- 
ing dots B4 and B5 on one side, SarhfSle ittldr$§ses 
(A41 to A45, A51 to A55. 641 to B*S, fed B51 f6 
B55) shown in HO. 42 may be uSdd aS sanfple 
addresses In the next step 2. In thfe ca§fe, sirfce tire 
niiftibef of sarrtple dddre^s poiftis df tffe stefc> 2 
increases from 9 to 10, the number of processes 


also increases from 8t to 100 (scanning lines). 
However/ since the processing of obtaining the 
middle point between the dots A4 and AS and 
predetermined sfcftfjjfe points are used, the pro- 
s ce&fttg eff ggrf&taiifcg sJoffe pull addresses of the 
step 2 at rifyp points amtind a middle point need 
not be perfQ%edi jf seem^ that the processing is 
reduced te&ytti^i 

Assume t^t tfte accurate center of the step 2 
10 is pr^ent^ t^M^^ft!^ 08t$ A4 6rtd AS, and ad- 
dress dat^on ^rbe'essing is parttfttted oft scan- 
ning lines conriectWf the dots A42 td A44, the dots 
A52 to A&4, the do® 642 to B44, and the dote B52 
to B54. in this <^S, th£ number df processes can 
75 be decreased ffefrfet fd ^6 (6 x 6): 

In the ab6ve #fd^S^ng, a rough center in step 
1 ia-0&fBM&$ 

As described above, fay detecting a CRC, 
whether data tifiSSRs reg&tarly arranged in the 
20 corresponding direction is detested. Referring to 
FIG. si&ft, as is appktent since the matter at the 
distant D2 Is a marker erroneously detected, if a 
seJfrch for data i$ perfonjied in flhat direcfioh, no 
upper addreSfe c&de As present Therefore, errors 
25 occur in the difeclidh in ail 81 detecting dperations. 
As a result, the absence of a direction is deter- 
mined. 

If the absence 6f 02 is determined in this 
manner, 01 arfd D4%& the nM Shortest distances. 

so In this dase. sihe& Section fe p&Hormed clockwise 
with resect fo^h6 current maffcferr of mterea*. pro- 
cessing with 1 reg$S& to to* distance 01 is per- 
fortrTed next. As rfe^c^bed atfov^, since ddfeftbffta* 
tion can ortiy $b 0&ft$ffi&ti righftfttd or downward, 

35 protiesstng is peW&fmed fmm me m|)fesentative 
manner to the mafter at the distance D1 fh this 
case. That 4s, codes are read fn the reverse direc- 
tion, i.e., from th^ 6RG cOd§ to ihe address code. 
As is a^hant ^r^fore. an enior is determined. 

40 Consequently. fH6 flBS&ftCfc df a diredfioh is deter- 
mined with respect t6 the distance D1. 

Dbtefmiftatflirn with respect to the distance 04 
is fjferfcrtaed nM. Since an address code arid a 
CftC code aTe rS&d in the didder Aamed wherv a 

45 read operatieri fe ^eddrhfted from the rdpresentative 
marker toward trie distant^ t)4, the presence of 
dird^vft? $ a§^flf«fii&gf Wtti feSjffefct to 04. Thit is. 
noe^bceur^ 

DStermlnllffah ts to be perfemied next with 

50 respect to tH^ distances bS ind 05 which are 
equal d?$ferffed& ©nde proft^ssin^ is perfbitned 
db36rt&, pf0&§$$6& \s p^rforfned first with re- 
spect to ttt^ (figaAc^ ©3. Wiih ^gard to 03 ds 
well, sfn6e a CftC code is n&d ffrst H is detected 

55 th^a tfteffe is rto (SKSetivtty. The diSfarit» 05 is 
eventually rfc&d, SHfl ft Is d#tenf9hed that there is 
dlrettivl'ty wtiH relp^ct to tKls tiiS&itt. 


27 


51 


EP 0 670 555 A1 


52 


As a result, since the distances D4 and D5 are 
read, it can be recognized that data corresponding 
to block addresses written at portions correspond- 
ing to the distance D4 and D5 are written in the 
portion indicated by hatching in FIG. 38B. If two s 
directions are detected finally with respect to one 
representative marker, the direction of the block 
can be detected. Therefore, processing is per- 
formed until two directions are detected. 

In the case of the dot code shown in FIG. 33, 10 
only one direction is detected* Processing is per- 
formed until one direction is detected (D5 in FIG. 
39). 

Note that if errors are detected upon process- 
ing in all the five directions described above, the 75 
above direction detection processing is performed 
with respect to markers in the diagonal directions. 
In this case, in order to prevent an increase in the 
number of processes, no processing is performed 
with respect to markers located outside a given 20 
range. Necessary information such as address in- 
formation, which could not be obtained, is obtained 
by marker/block address interpolation processing. 

As described above, a block address is not 
modulated. If, however, a block address is modu- 25 
lated, demodulation is required after a block ad- 
dress code is recognized, as is apparent. 

In the above description, the presence/absence 
of directivity is determined by using error detection 
of an upper address. However, for example, a 30 
pattern having directivity like "1t1 00001" may be 
used instead of an upper address CRC code so 
that when "11100001" is detected by a pattern 
matching operation or the like, the presence of a 
marker in the corresponding direction can be rec- 35 
ognized. 

In the above direction detection, adjaoent mark- 
ers need not be detected clockwise with respect to 
all markers. In the next block, an operation of 
recognizing an upper address code may be per- 40 
formed in that direction. This operation allows a 
decrease in the number of processes. Furthermore, 
even if abnormality occurs in detection of an upper 
address, the presence of a code in a direction 
obtained by peripheral direction detections may be 45 
recognized. 

The block address detecting/error determin- 
ing/accurate center detection section 300 will be 
described next with reference to the block diagram 
in FIG. 43 and the flow ch^rt in FIG. 44. 50 

Upon detecting an upper address, the upper 
block address calculation and center calculation 
circuit 372 in the data array direction detection 
section 218 sends the upper block address to a 
block address calculation and center calculation 55 
circuit 374 in the block address detecting/error 
determining/accurate center detection section 300. 
In addition, since rough centers in upper address 


detection are known, these center addresses are 
supplied to a step 2 sample address generation 
circuit 376 (step S152). 

The step 2 sample address generation circuit 
376 generates the sample addresses of this rough 
centers (step S154). More specifically, as shown in 
FIG. 45, eight sample addresses are set outside 
with respect to the previously obtained rough cen- 
ter (the center in direction detection) in the same 
manner as described above. Subsequently, eight 
sample addresses are set outside with respect to a 
marker whose directivity is found, and scanning 
lines are drawn in the same manner as described 
above (step $156), thereby performing processing 
to determine whether a lower address can be de- 
tected. In this embodiment, the data interval for the 
generation of sample addresses is defined as 0.5 
dots. This value, however, can be changed de- 
pending on the specifications of an apparatus, as 
needed. 

The address control section 220 reads out data 
from the image memory 214 in accordance with 
the generated sample addresses, and supplies the 
data corresponding to these sample points to an 
error detection circuit 378 (step S158). Similar to 
direction detection (as shown in FIG. 5), when a 
sample point is present between data in the image 
memory, the corresponding data may be obtained 
by interpolation using peripheral data instead of the 
scheme using one representative data in a mem- 
ory. If an error is detected in error determination 
(step S160), it is determined whether scanning at 
all the sample points is completed (step S162). If 
scanning is not completed, the flow advances to 
step S156 described above. If scanning at the all 
the sample points is completed, the flow advances 
to marker/block address interpolation processing 
(step S164) after addresses in all the blocks are 
detected. 

If it is determined in step S160 that there is no 
address error, it is determined whether scanning at 
all the sample points is completed (step S 166). If 
scanning is not completed, the flow advances to 
step S156 described above. If scanning at all the 
sample points is completed, a lower address is 
confirmed (step S168), and an accurate center 
(step 2 center) is decided (step S1 70). 

That is, error detection is performed by the 
error detection circuit 378, and the flow advances 
to the next processing if an error is determined by 
error determination. The block address calculation 
and center calculation circuit 374 has received start 
and end addresses in center detection, i.e., a signal 
indicating specific points which are currently con- 
nected, from the address control section 220. The 
block address calculation and center calculation 
circuit 374 determines whether error detection can 
be performed at the corresponding points. If no 
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error is detected, the block address calculation and 
center calculation circuit 374 combines the ob- 
tained lowef address wfjth the upp'er address sent 
from the upper block address calculation and cen- 
ter calculation circuit 872 and allies the resultant 
address as a block dddi$s$ to the martyr/address 
interpolation section 302. SimRarty, the block ad- 
dfe&s calculation and Center calculation circuit 374 
supplies the center address to the marker/address 
interpolation section 302, 

Referring to FIG. 46, the data interval is set to 
be 0.5 dots ior the fblldWitig reason. By detecting 
sample points vvHhfn the range of 0.5 dots, the 
'difference between the center (cehter in direction 
detection) finally obtained by this processing arid 
the true center falls within the range of 1/4 dots, tf 
the difference falls within the range of 1/4 dots, 
data can be accurately reproduced in a data area 
by setting sample points formed by the above 
processing. 

Since the minimum dot size of a step 2 code 
corresponds to one dot, a data Arrangement small- 
er than Oils dot site has no meaning as data. 
Therefore, it is constituted by one dot 

Similar to the step 1 code, inverted codes may 
be arranged on the upper arid lower sides of each 
address data dot, or black data may be set for a 
few dots at the end portion, while a marginal por- 
tion may be set around the black data. With regard 
to the data marginal portion 064 for discriminating 
an address code from a data code, even if ah afSa 
for discrimination from the data &f$$ 314 is black 
and superposed on die data area, the probability 
that the are§ Is mistaken for a marker fs very low. 
Therefore, title data marginal poftipn 364 need not 
be formed, find the data area 314 may be directly 
continuous with the Inverted layer. 

As shown in FIG. 45, as k result address data 
has a data length 1/2 the total data length in the 
form of lower and upper addresses, and fs added a 
CRC code K&vfng the same length. This data 
length fs set to allow detection of a bufct error even 
in a state wherein noise is superposed or an ink is 
attached to ah entire portion cbit35pdrtdihg to this 
address length, this data length ratio can be 
changed, as needed. 

Ah accurate center for sampling data in the 
date area 314 and a block address are recognized 
by die above tree search processing, i.e., the de- 
tecting method of obtaining a rough oenter at first 
and obtainlrig a mdre accurate centeh That fs, by 
performing tfde search processing, the processing 
cfirt be greatly redur^d rihd the processing Jkmoum 
and time can be reduced M fiofftpdred wi th a caSe 
wherein sarhpfirfg is performed at & tine pttcJi from 
ttfe Beginhing. In Sddi'tiSn. fine degree d! r88(ifi- 
dancy of a tbtD d§& amount can b6 reduced by 
usthg block addresses for detection of a direction 


and an accurate center. 

Themartcerteddmss interpolation section 302 
will be des^ftted next with reference to FIG. 46. 
Referring td Wfifc 46, assume that a marker of a 
s tyock B2 is ftjft q^teetaa or ah addfess of the block 
B2 is r&t detected, femfr black marker portion^ ar- 
ouhd th§ undetected marker of the block B2 are 
detected. 

In this case, a line connecting the obtained 

io centers of .the markers of Blbcfe B1 and B3 is 
drawn, and a line connecting the obtained centers 
of the m§rf(ef& of biock^ A2 and 02 is also drkwn. 
Trie Intersection <of tbeWfiaes is set as an estima- 
tion oenter. From this estfftattiofi center point, ad- 

75 dress detection and profcesslhg c#ri be performed 
toWard the mafkSrs of the stocks 02 ar\6 B3 Even 
if address detection is not performed, since an 
arrangement is known, ffiQ addrSSfc df the block B2 
can be set in accordance with addresses 

20 therearound when the block &2 is present below 
the block BY: T^erfcfbtev bslfiftation can bb per- 
formed Without d0tel3fibh. fmi fte address arid 
marker center of a block df Interest, which cbuld 
not be estimated, can be detected from processing 

25 around the blSck. 

The marfcejr/address interpolafion section 302 
supplies prdpefly read Address data, an address 
interpolated with a Center position, and (information 
abocit the e^rt&tion ^friter & flte address control 

30 section a^ogpi^Sr. 

If the datS is Ibaded into the image memory 
214 as shov^ lh PtQ . 46 Qnd the soanhlhg direction 
is the di^Qdh Indicted by the arrow, a marker 
located flfpp/^artiatelir at ah upper left position Is 

35 set as the ftrst fepmsen^ive rftarfcer, arul process- 
ing is started theorem. Detrfe> direction is ee- 
qudffiiaHy performed in the V^tfic^l direc&bn, and a 
first detecting operation in the vertical direction is 
perfomfSd tb obtain' dight eeftfei$ (Bfe markers of 

4o blocks A1 to A4 and the mafte'rS df bidtfcg 61 to 
B4). tn center dete&on tfi ftb n£& verOddl arrey, 
since the terffigft ef flte makers of the blodks B1 
to B4 have aireinSfy t&gn known, no pixJoessihg fdr 
them Is pdrfon£M& Uiif r<§£^h 6§fitete of the mark- 
kas ere 6f bld6ks Csl tp ©4. ttS-dSfflSfl of step t , and 
the centers df step 2 ere S&Stned on thef basis df 
the Renown cerftere. Thereto^ <He Shove 81 sfcsto- 
nin^ lines are net re^ulFeU &hoe k denier ob- 
tained, sampling txffif be $erfeifite« fit subsequent 

so nine potrtts. &r ffiB f£&s6h, a center can be tsfe- 
taihed by nine pfde^s^fe andfifh© finer processes, 
i.e., a tdtSl df 1$ $ita«33&. As described above, 
altridiigh ffie #ioiiJ« of 'ptfe^e^h^ IB targe only m 
first the efebpm of suyseiquniht processing can be 

55 ad^arftatfebu^y redfoetf. 

in wrc&0 9 (he deft «*8b shown in R& 33, 
dire'ctloii 6eW&S$h fStbc^sthg Is pJerfo^rhed first 
With reject to the bto&k Al. B1. and C1. i.e.. in 
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the lateral direction, with the block A1 at the upper 
left position being considered as a representative 
marker. When the marker centers of the blocks A1 
and 61 are obtained, center detection processing 
for the block C1 can be performed by nine pro- 
cesses. In order to determine that the block below 
the block A1 is the block A2, the following process- 
ing is performed because no address code is avail- 
able. 

That is, the size of the block may be deter- 
mined on the basis of the lengths of the A1 and B1 
markers, and detection may be started from a 
marker at a proper position on the basis of the 
estimated size of the block. Alternatively, process- 
ing may be performed while the marker imme- 
diately below the block A1 is regarded as a repre- 
sentative marker. With this operation, a block hav- 
ing a block address in the later direction which 
coincides with the detected block address may be 
determined as the block A2. When direction detec- 
tion on two stages (the stages of A1 and A2 in FIG. 
46) is completed, a direction can be estimated in 
processing in the vertical direction (processing of 
selecting the marker of the block A3). Therefore, 
detection processing may be performed with re- 
spect jo only th^ piarkers .in thjs 4jr£^on.,Even if 
there is an erroneously detected marker, process- 
ing can be performed without using the marker. 

The address control section 220 in FIG. 23 will 
be described next with reference to the block dia- 
gram in FIG. 47. 

In the address control section 220, first of ail, 
data from the A/0 conversion section 210 is stored 
in the image memory 214 by an address generated 
by a write address generation section 380 for gen* 
erating an address when data from the A/D conver- 
sion section 210 is to be written in the image 
memory 214.^. 

As described above, addresses need to be 
respectively generated in the marker detection sec- 
tion 216, the data array direction detection section 
218, the block address detection/error determina- 
tion/accurate center detection section 300, and the 
marker/address interpolation section 302. Address 
generation sections 382 to 388 are arranged for 
this purpose. In this case, the marker detection 
address generation section 382, the data array 
direction detection address generation section 384, 
and the address generation section 386 for block 
address detection/error determination/accurate cen- 
ter detection generate addresses by exchanging 
information with the marker detection section 216 
(the marker determination section 318, the marker 
area detection section 320, and the approximate 
center detection section 322 in the marker detec- 
tion section 216), the data array direction detection 
section 218, and the block address detection/error 
determintion/accurate center detection section 300, 


respectively. The interpolation address generation 
section 388 generates interpolated address coordi- 
nate data and memory read addresses for pixel 
data around there, the interpolated address coordi- 

s nate data being obtained by dividing a block having 
four markers therearound into equal portions in 
accordance with addresses (to be referred to as 
marker addresses hereinafter) to which the ac- 
curate centers of the respective markers are caus- 

70 ed to correspond in the image memory, and a data 
count. 

A selection circuit 390 selects these address 
generation sections 382 to 388 at the respective 
timings to supply corresponding data to a lens 
ts aberration distortion correction circuit 392. The lens 
aberration distortion correction circuit 392 receives 
lens aberration distortion information from the 
memory 224, converts (corrects) a selectively sup- 
plied address, and supplies the resultant data, as a 
20 read address, to the image memory 214 via a 
selection circuit 394. 

Another embodiment of the marker determina- 
tion section 318 in the marker detection section 
216 will be described next with reference to FIGS. 
25 48 to 50. 

In the above embodiment, when the size of a 
dot code is determined, the dot code is imaged by 
the image formation optical system 200 such that 
one dot of the code corresponds to 1.5 pixels; as 
30 image pickup elements of the image pickup section 
204. In the marker determination section 318, two- 
dimensional consecutive black pixels are found and 
determined as a marker. In contrast to this, in this 
embodiment, when codes having different dot 
35 sizes, e.g., a 20-um code, a 40-um code, and a 
80-um code, are present the respective codes can 
be reproduced without changing the image mag- 
nification of the image formation optical system 
200. 

40 In various applications, different paper qualities, 

different sheet characteristics, different inks, and 
different printing levels are set For this reason, 
codes having dot sizes corresponding to the re- 
spective applications are used. If, for example, a 

45 very high recording density can be realized, a 20- 
um code is used. In an application using a rough, 
low-cost sheet with poor quality, a 80-um code is 
used. It is an object of this embodiment to decide 
the size of a code and reproduce the code properly 

so in such a state. 

Assume that there are circular markers having 
dot sizes of 20 um, 40 urn, and 80 urn as shown 
in FIG. 48, and a reproducing apparatus to which 
this embodiment is applied is an apparatus for 

55 efficiently reproducing a 20-um code, i.e., an ap- 
paratus in which the magnification of an image 
formation system is set to decode a larger amount 
of information with one imaging operation. It is an 
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object of the embodiment to reproduce 40-um and 
60-um codecs wtffibut tfiangtrig the irrfage mag- 
nification of the Image formation systeto in the 
apparatus for Imaging this a&-Mm dot dt an imagb 
magnification of x t.6. Note that the sfee of eabh 
marker shown In HQ. 48 has a diameter seven 
times a corresponding dot size. 

As shown in RGt 49, fir^t of all, a code having 
the maximum dot ste$ to be selected f$ set to be 
an initial v&ub (fefep 618$ i^for i^ttfft, 
40-Um f and ZOHim codes afe present, and all the 
codes are to be reprodueid, the 8£Him code hav- 
ing the maximum sst to be an initial vfclue. 
TRW code may be $3t by a key tftfcut operation 
performed by the user. If three types of codes, i.e., 
8(Him. 40Httm, and 20-um bodes, are set, and the 
apparatus cah perform proper processing only with 
respect to these sizes, the apparatus may set by 
fts&tf a code having the maximum size, i.e., a 80- 
um code. 

Determination is performed according to a 
marker determination formulae shSwfi ih FIG. 48 to 
obtain a temporary center (step $184). 

Assume that a code is formed by using 7-dot 
portion of each dot size as a marker. At this time, 

* since the irhage formation system has an image 
magnification of x 1.5, an Image of a code 

^ has a diameter corresponding to 10.5 dots; ah 
image of a 4&um code, a diameter corresponding 
to 21 dots; and an image of an 80-um code, a 

* diameter corresponding to 42 dots. For Ms reason, 
^ if 7 or more and 12 or less two-dim^risioiiaify 
~ consecutive black pixels' are detected/the cor* 
' responding portion is determined as a 20-Um code 

marker. If 14 or more and 24 or less two-dimen- 
sionally consecutive black pixels are detected, the 
corresponding portion is determined as a 40-um 
code marker. If 29 or more and 47 or less two- 
dimensionaliy consecutive black pixels are detect- 
ed, the corresponding portion is determined as a 
80-um code marker. 

This pixel value is calculated according to the 
following formulae: 

r «= s x d x m 
int(r x 0.7) <£ R S fht (r x 1.1 + 1) 

r : the number of pixels (-7) correspond- 
ing to the diameter of a marker 

s : the dot siz6 (20 Um, 40 urn, or 80 um) 

m : the im&ge m^ghtfi&Sibn (= i .5) of the 
image formation system 

d : the number of ddtS corresponding to 
the diameter of the marker 

R : the number of pixels corresponding to 
thS diameter of th§ marker as a binary 
image 

0.7 : the reduction ratio based on the inclina- 


tion, dot rejection, and the like 
1.1 : the magnifying power based on dot 
gain 

Since an 80-um code marker Is initially set in 

5 step ST82, it is cheeked in step S1B4 aceordirtft to 
the above marker ddfemiinatlon formulae whether a 
marker & an *8Q^um r ctde maker, and a temporary 
center of 49$h ^nabkeir of the corresponding size (a 
marker corfemuted ^y a 80*iim dot) is obtained. 

io SUbsequ&htly, it is gfi^bked wh'ethef the num- 
ber of mj^el^ is four bt mote <$tep S188). 
Since o?te block is surrounded by four markers, 
this operation is performed to determine Whether 
one or mote blocks aft pm&nt 

75 It is then checked whether the markers have 

predetermined positional relationships with adjacent 
markers lik& ttiblfc m&tih in AG. 50. i.e., whether 
the markers are ptepSily arranged (step S188). 
That is, a marker B located near a target marker A, 

20 a marker C located near a position separated from 
the target rhtfftter A tsjra distance D in a direction 
perpendicular fa £ line J oon«boting the markers A 
arid B, arid a marked D located near a position 
separated from the marker B by the distance D in 

25 the same direction las ^KSt ff oft the marker A to the 
marker C are dented. If thbse markers are 
present, an 80*um W$b is dSiemliried in this case. 

ff it is determined* In step &186 that the riorftber 
of SO^Um code ifraikers is less than four, or rt is 

so determined ih st&p S188 that the markers, are not 
property afra&nged, it is deft€*flf«hed that the cer- 
responding |&rten \$ hot an SOntm code. In this 
ca^e, a code having a #ze smaller than that of the 
previously set c&te by one level, i.e., a 

35 code in this ca^e, ts set (step $190), and me flow 
returns t6 step,' SI B4 to perform marker determina- 
tion again. 

If detemnirtation eannot be performed with the 
smallest cod&siie, the corresponding portion is not 

40 a code or a code Which canndt be reproduced. 
Therefore, thp processing is terminated. In fht$ 
case, the fidw preferably advances to processing of 
generating a warning sqch as an alarm. 

Another embodiment of the niato determlna- 

45 tion sectidh 8i6 will be described next. A method 
of deteithinlng a rharKer pdttem and modulated 
data* by distort as QerfStel tfhagffc pi*oc^§sf|^f. in 
this c&se. dfl$i6h proc§siaW§ is progressing of con- 
verting a black pixel rtfer a white pixel into £ tfftite 

so pixel. tflofe d^cifiSiny, if , for ex&ihple, thrii& pixels 
arband a target (in an &r£a of 7 x 7 pixels 
around the target p&dl) are checked (blackAvhite 
determihatidhj), at toist one of them is a wtttte 
piieei, the tffl^t 6ixeJ Is converted rrfto a whffe 

55 pb^l. Th& rlrOee^tr^j Is perfHftited with respect to 
all the 0lWs6n an lmSg^. 

f^irst of air, binariiatibn processing of d^ta in an 
image mertidry Is pifformed. 
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Subsequently, only the data portion of the code 
image is converted into white pixels by the above 
dilation processing, and a marker pattern portion is 
converted into an image smaller than the original 
size by an amount corresponding to the number of 
pixels having undergone dilation. 

The number of consecutive black pixels is 
counted from addresses of points where the white 
pixels on the image are changed into black pixels 
in the image memory and the corresponding pixels. 
The information about each marker is classified for 
each marker in accordance with the above informa- 
tion. The above temporary center address and the 
range in which the markers are present are de- 
tected. Thereafter, approximate center detection 
processing is^performed. 

With this operation, marker determination and 
detection of the range in which the markers are 
present can be performed at high speed. 

Furthermore, in a code in which markers have 
undergone uniform deformation with respect to the 
marker center, e.g., the above-described dot gain 
or dot reduction, the temporary center address 
obtained by the above marker determination may 
be directly set as an approximate center. 

The processing in step S184 in FIG. 49 may 
be used as the above processing. 

When the operation of the above A/D conver- 
sion section is performed by binarization using a 
comparator, binarization processing in the marker 
determination processing can be omitted. 

A light-source-integrated image sensor which 
can be applied to the detection section 184 of the 
reproducing apparatus shown in FIG. 17 or 23 will 
be described next. FIG. 51 shows the arrangement 
of the image sensor. For example, light-emitting 
cells 398 are formed beside light-receiving cells 
396 by an on-chip process using compound semi- 
conductor elements such as LEDs or elec- 
troluminescence elements. Grooves are formed be- 
tween the light-receiving ceils 396 and the light- 
emitting cells 398 by actually cutting the wafer with 
a cutter, and non-transparent portions, e.g., isola- 
tion (light-shielding) portions 400 obtained by em- 
bedding a metal, are formed in the grooves. The 
isolation portions 400 serve to eliminate the incon- 
venience that light emitted from the light-emitting 
cells 398 is directly incident on the fight-receiving 
cells 396. 

In this arrangement, emission of each light- 
emitting cell 398 is controlled by a light-emitting 
cell control pulse signal like the one shown in the 
timing chart in FIG. 18. Each light-receiving cell 
396 supplies stored charges to an adjacent vertical 
charge transfer register 402 upon application of a 
charge transfer gate pulse signal to a charge trans- 
fer gate (not shown). Each vertical charge transfer 
register 402 transfers stored charges to a horizontal 


charge transfer register 404 in units of lines in 
response to a vertical charge transfer pulse. The 
horizontal charge transfer register 404 outputs 
stored charges in unite of pixels via a buffer am- 
6 plifier 406 in response to a horizontal transfer clock 
signal. 

An embodiment wherein a portion, of the circuit 
of the above-described reproducing apparatus, lo- 
cated before the demodulation circuit is realized by 

70 an analog circuit and formed into one chip will be 
described next with reference to FIG. 52. In this 
embodiment, as an image .pickup section, an X-Y 
addressing image pickup section 408 represented 
by a CMD like the one disclosed in Jpn. Pat. 

75 Appln. KOKAI Publication No. 61-4376 is used. 
With the use of this section, no memory is re- 
quired, and only a small circuit system is required. 
Therefore, the circuit can be formed on one chip. X 
and Y decoders 410 and 412 are prepared for 

20 address scanning of this X-Y addressing image 
pickup section 408. 

In a general X-Y addressing image pickup sec- 
tion, after one line is read, this line is reset and the 
next line is read, unlike a CCD. That is, this image 

25 pickup section generally uses a read method in 
which while a given line is read, an exposure 
period for another line is started. According to such 
a read method, however, when external light is 
incident during an image pickup period, an unnec- 

30 essary portion is exposed. Owing to such a de- 
merit, in this embodiment, in addition to the X-Y 
address scheme, an element shutter is used in 
such a manner that exposure is performed only 
when external light is incident, i.e., exposure is to 

35 be performed, but no exposure is performed other- 
wise. 

An image pickup element scanning address 
generation and element shutter control section 414 
generates an element shutter pulse for an opera- 

40 tion equivalent to an element shutter according to 
the X-Y addressing scheme, and a reset pulse for 
setting all the pixels. 

The X and Y decoders 410 and 412 are circuits 
for turning one of the elements in accordance with 

45 X and Y addresses from the image pickup element 
scanning address generation and element shutter 
control section 414. These circuits are generally 
constituted by shift registers and the like. In this 
embodiment however, the circuits constitute a se- 

so lector capable of turning one of the elements in 
accordance with signals from the image pickup 
element scanning address generation and element 
shutter control section 414. 

The reset pulse in this embodiment is equiv- 

55 alent to the image pickup element reset pulse in 
the timing chart in FIG. 18. This reset pulse serves 
to reset each image pickup element before expo- 
sure. By setting the reset pulse at Hi during this 
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reset period, a switch 416 is switched to supply all 
the charges to a negative riower supply 41 8. 

As Imllcated ty M ^av^drfh irtdic^ed by th6 
broken line In R9. 18/ the eletment shutter pulse is 
generated to have a watf$forhl wftfdh allows a gdte 
operation in the time interval batWeen the tilling 
edge of a reset pul^e and the eftd of exposure. 

In a read operation, similar to a normal pulse, 
the elements are sequentially turned on, and signal 
charges are su(5plied to a marker defection seetioh 
422 via the switch 4t6 for a resdt period after the 
charges are dj^0lified by A c^VreKt/voftdg^ conver- 
sion amplifier 420. The marker deteo&&fi section 
422 is the; same as that described abOves and data 
having undergone marker detitftibn is stored ih a 
register 424. A 0 det&etkin Section 426 obtains an 
indiftMiOn oh the bSteiS bf the contents of the 
register 424 in tire same manntf as the above- 
described direction detection section, for example, 
in the circuit shown In FIG. 23, the e deteetidh 
section 426 corresponds to the data array direction 
detection section 216, add a data Interval control 
section 428 and th^ lffi$$e pickup ^lerherit fccafi- 
ning address generation and element shutter con- 
trol section 414 correspond to the address control 
section 220. 

Coefficients for interpolation, which are gen- 
erated by a coefficient generation seetioh 430 un- 
der the control of the data interval control section 
428, are multiplied by the read charges by a mul- 
tiplying circuit 432, and all Ofe products are added 
by an addition cfrt&ft 434. That is, an output from 
the addition circuit 434 Is skmplkd/herd by a sarri- 
ple and hold (S & H) circuit 436, and is returned to 
the addition circuit 434 via a switch 438: This 
operation is perforrhed to perform data interpolation 
like the one shown in FIG. 5 when data is sampled 
after a direction and a scanning line aire confirmed. 
Referring to FIG. 5, in order to obtain data at Q, 
interpolation is performed by multiplying coeffi- 
cients and 06, D7, 010, and 011. The value inter- 
polated in this manner is further sampled/Held by 
an S & H circuit 440, and bfnartzation 6t the Sam- 
pled/held value is performed By a comparator 442 
and a threshold value determination circuit 444. 

Each imajje pickup element (pixel) of the X-Y 
addressing image pickup SSbtibh 408 will be de- 
scribed in more detail. Each pixel is constituted by 
two CMb elements, as shown in Fl<3. 53 Ah ele- 
ment shutter pulse is input to a first CMD elemerit 
446 to store ch&rges in a capacitor 448 for an 
element shutter. Thereafter, a s&ond CMD ele- 
ment 450 is driven by a read fiftf&e from the Y 
decoder 412 to select a line so as to read out 
charges in units of pixels via a horizontal selection 
swttdi 4S2. 

In an exposure operation, the CMD element 
446 is caused to perform an element shutter opera- 


tion by an element shutter pulse to store charges 
in the elSmem 6hi#e'r capacitor 448. When 
ohafgas are stored frt%fs mariner, fight Is shielded, 
and a read poise from the Y decoder 412 Is ap- 

s plied, thereby s&atfUtfQ a lirwf The CMD element 
45d Is uSfefi tufrtefl by the hbrizontat selection 
sfoMih 4Sjt& f&d biii^fieS in uhftsof pbWR; 

When 'ch^as ari to be reset, all horizontal 
8efM^ r "^^W' s #^firrfi§ti oh by a raid 

ro pul^e 6uti>u1 irom the (magfe £fck# element sosufi- 
nirijjj address generSHpn and element shutter con- 
trol Section 4 14, as^ the &fflcto 416 fdr a rebet 
peWod *s i&Gh WM^A pfcWar supply 4i8 
side. Since the source of the 0MB element 450 is 

75 s£t at a negativb voltage, th6 charges stored in the 
cap&ditor 498 and the gate of the CMD element 
446 are move& td the negative power supply so as 
to be reset 

Charges can also be reset by simultaneously 
20 applying voftages slightly higher than those in the 
above operation as the voltages of ah element 
shutter pulse and a read pulse. 

Note that a dark current poses a problem in a 
general image pickup element In this embodiment, 
25 however, since exposure is performed only during 
a period in which the element shutter pulse shown 
in RG. 18 is at high t$vdi, sfitd charges are imme- 
diacy read 6ui tffe time during whTch a dark 
current is stored is very shdrt ih practice. There- 
to forei, this inr^ge pickup element is advantageous 
ovefr other impe pickup elements in tSrrhs of S/N 
ratio. In an SkpftSure operaton, since a sufficient 
amount of n^ftt te jirdVrded ev^n during this short 
expblfire' petloti, the S/N level is low with respect 
35 to a dark current while the si^naa level remains {fie 
safrfo. therefore, witfi die application of this em- 
bodiment, the gain of tfi§ degree of output of the 
. currentA/oltage - coinfverslOh amplifier 420 on the 
subs&qu^m stage can be set to be a considerably 
40 large value, 

In this embodiment, a pixel arrangement is 
designed to pprform the above element shutter 
operation. (However, a CMO Element c^pabfd of an 
element shutter operation as disclosed Iff Jpn. Pat 
45 Appfn. KORAI PubJIi^flon No. 51-4376 may be 
used. 

An embodiment in which the circuit using tfte 
above X-Y e$dr&sfhg image pickup section 408 is 
formed as a thre6-dfmensionaJ IC will be described 

so next with reference to FIG. 54. Note that this em- 
bodlmerit lis associated With an audio inform^tibn 
r^p^dacirtg app^itus. 

This emb&tftf&nft is constituted by an Image 
pickup secflcih taster 454 opftfeing trtS ftiper sur- 

55 face of a sheet 1 §2 and including § X-Y addressing 
imdge pickup section 406, ah X decoder 410, and 
a Y decbd^V 412, a detectfbh section layer 456 
stacfcetf/forfndd on tfJe Tvtt^e pickup s&Abh layer 
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454 and designed to detect data, and an output 
processing layer 458 stacked/formed on the detec- 
tion section layer 456. The output processing layer 
458 includes a demodulating section 190, an error 
correction section 1d4 t an decompression process- s 
ing section 256, a data interpolation circuit 258, a 
D/A conversion section/output buffer 266, and the 
like. The output processing layer 458 reproduces 
decoded audio information as a sound through a 
speech output device 268 such as an earphone. 10 

It is apparent, as described above, that the 
output processing layer 458 can be designed to 
reproduce multimedia information including image 
information. 

By forming the above circuit into a three-di- is 
mension IC, processing can be performed up to a 
sound output operation. Therefore, the circuit size 
can be greatly reduced, leading to a reduction in 
cost. <, 

Examples of the arrangement of a pen type 20 
information reproducing apparatus will be de- 
scribed next. 

For example, a switch for designating a timing 
of a dot code loading operation can be arranged in 
a pen type information reproducing apparatus. 25 

FIG. 55 shows an example of the apparatus. 
The detection section 184 including the light 
source 198, the image formation optical system 
200, the spatial filter 202, the image, pickup section 
204, the preamplifier 206, and the image pickup 30 
section control section 212 in the reproducing ap- 
paratus shown in FIG. 17 or 23 is arranged in a 
distal end portion of this pen type information re- 
producing apparatus. The scan conversion section 
186, the binarization processing section 188, the 35 
demodulating section 190, the error correction sec- 
tion 194, the decompression processing section 
256, the data .interpolation circuit 258, and the like 
are incorporated, as an image processing section 
460, a data processing section 462, and a data 40 
output section 464, in the apparatus. The apparatus 
includes an earphone as the speech output device 
268. FIG. 55 shows only an audio information out- 
put unit. As is apparent, however, if the apparatus 
incorporates a processing section for images, char- 45 
acters, line drawings, and the like, the apparatus 
can be connected to a corresponding output unit 
(the same applies to the following description of 
the pen type information reproducing apparatus). 

A touch sensor 466 is arranged on a side so 
surface of this pen type information reproducing 
apparatus. As this touch sensor 466, for example, a 
piezoelectric switch, a microswitch, or piezoelectric 
rubber can be used, and a compact switch having 
a thickness of 0.6 mm or less is known. The control ss 
section as the image pickup section control section 
212 starts to load a dot code like the one described 
above in response to depression of the touch sen- 


sor 466 by a finger of the user. When the finger is 
released from the touch sensor 466, the loading 
operation is terminated. That is, the start and end 
of a dot code loading operation are controlled by 
using this touch sensor 466. 

Note that reference numeral 468 in FIG. 55 
denotes a battery as an operating power supply for 
each portion in the pen type information reproduc- 
ing apparatus. 

In addition, the touch sensor 466 may be at- 
tached to the distal end portion of a pen type 
information reproducing apparatus as shown in FIG. 
56 instead of being depressed by a finger of the 
user. With this arrangement as well, the same 
function as described above can be realized. 

When the user puts this pen type information 
reproducing apparatus on a sheet 182 to manually 
scan a dot code printed on the sheet 182, the 
touch sensor 466 is turned on. The image pickup 
section control section 212 recognizes it and starts 
to read the dot code. 

In this case, since the distal end portion of the 
pen type information reproducing apparatus is 
moved in contact with a sheet surface in a scan- 
ning operation, the distal end portion of the touch 
sensor 466, i.e., the surface which is brought into 
contact with a sheet surface, is preferably coated 
with a smooth resin material or the like to allow 
smooth movement in manual scanning (move- 
ment). 

In addition, the detection section of the pen 
type information reproducing apparatus may further 
include a mechanism for preventing specular re- 
flection. 

FIG. 57A shows the arrangement of the mecha- 
nism, in which a first polarizing filter 470 is ar- 
ranged in front of the light source (LEDs or the like) 
198, I.e., on the side where light is radiated, and a 
second polarizing filter 472 is arranged in front of 
the image formation optical system (lens) 200. 

For example, as shown in FIG. 57B, the first 
polarizing filter 470 is formed by cutting a polariz- 
ing filter film 474 in the form of a doughnut. The 
second polarizing filter 472 may be formed by 
using a different polarizing filter film 476, or the 
inner portion which is cut from the polarizing filter 
film 474 when the first polarizing filter 470 is 
formed, as shown in FIG. 57C. 

The first and second polarizing filters 470 and 
472 formed in this manner are arranged such that 
the pattern surface (polarizing surface) of the sec- 
ond polarizing filter 472 is perpendicular to the 
pattern surface (polarizing direction) of the first 
polarizing filter 470. 

As a result, the plane of polarization of random 
light emitted from the light source 198 is limited by 
the first polarizing filter 470 to radiate, for example, 
P-polarized light A specularly reflected light com- 
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ponerrt returns, as P-polarized tight from the sheet 
surface with lis plane of polarization being main- 
tained. Kowevef, dnfce me ptefte of po&ttiation of 
the second polarfelng "fitter 472 is perp&ndteutar to 
that of the first polarizing fitter 470, this specularly 
reflected light component is cut by the secbnd 
polarizing filter 472. Gn the other hand, light output 
frbrti the first polarizing filter 470 is incident on 
actual dots, i.e., the sheet surface and returns as 
luminance information on the sheet surface. The 
plane of polarization of such light becomes ran- 
dom. Therefore, a signal which is incident oh a 
sheet surface and returns as mondchrome informa- 
tion or color information has both P- and S-po- 
Ifirlzed light components. Of these light compo- 
nents, the P-polarized light component is ait by 
the second polarizing filter 472, but the 8-polari^ed 
light component perpendficular to the P-polarized 
light component passes through the second po- 
larizing filter 472 and is actually focused on the 
image pickup section 204 via the lens 200. That i€, 
the reflected light frbm which the specularly re- 
flected light component is removed is guid&d to the 
image pickup section 204. 

In this case, a x/4 plate 1230 is arranged in 
front of the spatial filter 202 so that im6§e light 
incident as linearly polarized light is converted into 
m: cfrculaHy polarized light iaHd input to the spatial 
^ filter 202. Such an arrangement is employed be- 
■ - cause the spatial filter generally os&s the blrefrin- 
*- gence of quartz and hence caftnot exhibit its effedt 
r * with linearly polarized tight fh tfiis case, the X/4 
r plate 1230 Is arranged hi front of fhe spatifel filter 
202. However, the present invention is not" Iftftlfod 
to this. The X/4 plate 1230 may be arranged in an 
arbitrary place between the second polarizing filter 
472 and the spatial filter 202, Wfttre the X/4 plate 
1230 can be easily arranged. 

As an arrangement for removing a specularly 
reflected light component ih this manner, an ar- 
rangement like the one shown in FIG. 58 is also 
* conceivable. In this arrangement, instead of dis- 
posing the first polarizing filter 470 ne&r the light 
source 198, the filter is disposed at the fexft portidn 
of an optical waveguide member 480 consisting of 
a transparent rdsfn and having a surface mirror 
coat 478. The optical waveguide member 480 is 
used to guide light from the light Source 198 to a 
state very cloSe to a sheet surface to irraditfe ihe 
sheeft (dot code) with the light in this case, the first 
polarizing filter 470 is arranged such that light 
perpendicular to the second polarizing fitter 472 is 
transmitted th^ethrou^h. 

With the Use of the optical waveguide member 
480, the following rh^rtts can be obtained. Tfte light 
source 108 and outer shape din be greatly nar- 
rowed. Since the Incident riffgie iVdecreas&d, Ihe 
specularly reflected light component cin b£ re- 


duced. 

Note that since some specularly reflected light 
component is left because Of dwelling of an ink, 
$#e!Iing of a sheet surface, or the like, a pdfarizing 

s fiffer is arranged to further efficiently remove the 
light component. 

In 6ddHi0h, instead of the second polarizing 
filter 472, an ota&rep^ticfcl Element Shutter 1220 
sue* as a liquid crystal shutter or a PLZT shutter 

10 may be art angsdv Af shown in i*IG. 59, this elec- 
trooptical element shutter 1220 is constituted by a 
polarizer 1221 as a polarizing filter, an eiectroop- 
tical element 1222 t\x6h as a liquid crystal or PLZT, 
and ^n analyzer is a polarizing filter. In this 

75 case, a specUlar reflection preventing effect can be 
obtained by disposing the shutter 1220 such that 
the Aligning direction of the polarizer (polarizing 
filter) 1221 of * tte ^leetrooptical element shutter 
1220 coincides with that of the second polarizing 

20 filter 475. 

With the shutter function, a frame read opera- 
tion can fed performed by an image sensor capable 
of a field read federation, e.g., dn IT-CCD, or si- 
multaneous exposure of all pixels can be realized 

2s by using an X-Y addressing image sensor such as 
a CMC 

An attempt to make the light source 198 por- 
tion efficient so as to siirh down the apparatus will 
be deseed rtekt. 

30 FIG. 60 A shows the arrangement for this at- 

tempt Similar to the case shown in F16. 58, this 
arrangement includes a transparent acrylic resin 
optical waveguide member 480 having a mirror 
coat 478 on ite surface. As shown in FIG. 60B, the 

as tran^p&reht acrylic tesin optical waveguide member 
480 is formed ffttb a truncated cone and has a 
threaded portion 482 oq its upper portidn (de- 
crimpresSthg eftd pbrtiim). The transparent acrytie 
resin optical waveguide member 480 is threadabiy 

40 engaged with a hoi&ing 484 of the pen type in- 
formation reproducing apparatus. TKd surface mir- 
ror coat 478 is not formed oh an inner portion near 
the threaded portion 482, ahd the tight source 198 
is arranged on a portlori 438. That is, the ligfft 

45 source 198 is provided as a ring-like LED array 
obtained by mounting L£Ds on a narrow flexible 
board 480. This L6£> drray is bortdetf to the portion 
486 on which the aipdve surface rhfrrbr co^t is ndt 
fdrmed. As shown lift FIG. 6$fe, the lower portibh 

so (distal enci portlSrO of th6 transparent acrylic rfesin 
optical waveguide member 480 is cut to form a 
portion 490 on which tfre surface mirror cbat 478 is 
not farmed. Th^tefore, light from the light source 
198 infers thfc transparent acryflc resin optical 

$s waveguide member 4&0 via the above non-mlrrdr- 
coat portion 468. T\\6 flgtft is then reflected by the 
surface mirror coat 478, enrlerges frbiYt the non* 
mlrror<oat pdrti&h 4d0 of fhe distal end portion via 

35 
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the transparent acrylic resin optical waveguide 
member 480, and is irradiated on a dot code on a 
sheet 

Note that the distal end portion of the transpar- 
ent acrylic resin optical waveguide member 480 
may not be bent, and the surface mirror coat 478 
may be formed only an outer portion, as shown in 
FIG. 60D, thereby realizing a shape which facili- 
tates the manufacture of the member. In this case, 
it is more preferable that the distal end be rounded 
to slide easily. 

An example of the pen type information re- 
producing apparatus using the light-source-integrat- 
ed image sensor will be described next (see FIG. 
61). 

In this embodiment, a light-source-integrated 
image sensor 492 like the one described with refer- 
ence to FIG. ,51 is used, a rod lens (e.g., a SEL- 
FOC lens or &a convex lens) 494 as an image 
formation system and a thin glass plate 496 are 
arranged on the exposure surface of the sensor. In 
this case, the thin glass plate 496 serves as a 
protective glass for an actual contact surface, and 
also serves to ensure a certain distance to make 
illumination as flat as possible. 

By using the light-source-integrated image sen- 
sor 492 in this manner, the pen type, jnfprmation 
reproducing apparatus can be made compact and 
reduced in the longitudinal direction as well. 

A pen type information reproducing apparatus 
capable of processing a- dot code as color mul- 
tiplex data will be described next. 

FIG. 62 shows the arrangement of this appara- 
tus, which has a touch sensor 466 like the one 
shown in FIG. 55 and first and second polarizing 
filters 470 and 472 like those shown in FIG. 57A. 
Furthermore, the pen type information reproducing 
apparatus of this embodiment includes a color liq- 
uid crystal 498 controlled by a control section 212 
and arranged on the pupil plane of the lens 200 so 
as to read a color multiplex dot code obtained by 
synthesizing a plurality of dot codes consisting of 
different colors, as shown in FIG. 63A. 

An application of a color multiplex dot code will 
be described first to explain how the control sec- 
tion 212 controls the color liquid crystal 498. 

Consider, for example, as shown in FIG. 63B, 
an A4 sheet 500 on which a color multiplex dot 
code 502 is arranged, a phrase "Good Morning" is 
written in correspondence therewith, and indexes 
504 and index codes 506 are arranged at a pre- 
determined position, e.g., a lower right position. 
When the color multiplex dot code 502 is to be 
reproduced by this pen type information reproduc- 
ing apparatus, one of the index codes 506 ar- 
ranged in correspondence with the indexes 504, as 
shown in FIG. 63C, is scanned and recognized to 
select one of the following choices indicated by the 


indexes 504: causing the apparatus to output au- 
dibly "ohayou gozaimasu" in Japanese; causing 
the apparatus to output audibly "Good Morning" in 
English; and causing the apparatus to output au- 
s dibJy "Guten Morgen" in German. When the color 
multiplex dot code 502 is scanned after, for exam- 
ple, the choice "Japanese" is selected, "ohayou 
gozaimasu" is output audibly. The above operation 
is the object of this embodiment. The following 
io description is associated with this object. 

First of all, as shown in FIG. 63A, a dot code 
audible in Japanese is generated and is assigned, 
as code 1, to red (R). Similarly, a dot code audible 
in English is generated and assigned, as code 2, to 
is green (G). A dot code audible in German is gen- 
erated and assigned, as code 3, to blue (B). The 
color multiplex dot code 502 is then recorded on 
the sheet 500 such that the color of a portion 
where the respective pieces of information are 
20 superposed is a color obtained by an additive color 
process. In this case, a portion where colors are 
not superposed on each other is recorded as a 
black dot. That is, although a dot code is con- 
stituted by markers and data dots, as described 
25 above, the markers are recorded in black and the 
data dots are recorded in a different color by the 
additive color process. To perform a recording op- 
eration with the color multiplex dot code 502 is to 
increase the recording density. 
30 Note that the colors of information are not 

limited to the above three colors, i.e., R, G, and B, 
but different pieces of information may be assigned 
to colors of wavelengths in different narrow bands. 
Therefore, more types of information, e.g., four or 
35 five types of information, can be multiplexed by 
using colors of wavelengths in different narrow 
bands. In this case, as color inks, inks mixed with 
coloring agent (inks reflecting only light compo- 
nents having narrow band wavelengths) are con- 
40 ceivable as well as conventional inks such as cyan, 
yellow, and magenta inks. 

The index codes 506 are arranged on the un- 
derline portions of the indexes 504 indicated by 
characters or pictures to be recognized and se- 
45 lected by the user. The index codes are recorded 
in black to be read regardless of a selected color. 

The color liquid crystal 498 is formed by bond- 
ing R, G, and B light-transmitting mosaic filters in 
correspondence with liquid crystal pixels. The color 
so liquid crystal 498 serves to separate pieces of 
information of the respective colors of the color 
multiplex dot code 502. That is, the color liquid 
crystal 498 is controlled by the control section 212 
to transmit only pixels corresponding to the color of 
55 information selected by scanning one of the index 
codes 506. In addition, the liquid crystal may be 
designed to surface-divide an optical path, instead 
of being arranged in a mosaic state. In this case, 
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the divided surface area ratio of each color te 
preferably set in inverse proportion to the sensitiv- 
ity of a pixel so as to make ihb sensitivities of the 
respective colors unifanrft. That ifc, when a sensitiv- 
ity for B is low, the corresponding area is set larger 
than those of other colors. In additidh, the dolor 
liquid crystal may be arranged on the fight source 
side. 

An operation of reading one of the index codes 
506 and selecting a color to produce an output in a 
desired language will be described next with refer- 
ence to the flow chart in FIG. 64. 

When, for example, green is selected by initial- 
ization (step S2t>2) t and the touch sensor 469 is 
depressed (step $204), the 1 control section 212 
controls the liquid crystal transmission portion of 
the color liquid crystal 498 in accordance With the 
color selection (step S206). For example, in an 
initialized state, since green is selected, onty the 
dots having green filters ate made transmi$$ive. 
Subsequently, the light sottfce 198 Is controlled by 
the control section 212, and a dot code read by 
the image processing section 460 (step 8208). The 
code is decoded by the data processing Section 
462 (step S210), and it is checked whether the 
entire code is processed, i.e., the entire code is 
read (step S212). If the entire code is read, a 
sound for informing it is generated (stSp 8214). 
The control section 212 then determines from the 
decoding result whether the read cod£ is one of 
the index codes 506 or the sound information (col- 
or multiplex dot code 502) (step 8216). ff the index 
code 506 is determined, the color indicated by the 
index code 506 is selected (Step 3218?. and the 
flow returns to step S£o4 described above, ff the 
code is the wuhd Information, the d&fa output 
section 464 causes the speech output device 268 
to reproduce the Sound (step 8220). 

After sound reproduction in step S220 de- 
scribed above, it is further determined whether fffe 
sound is repeatedly generated a predetermined 
number of times (step S222). If the fibmt&Y of 
times is preset by a repeat switch 467, the sound 
is repeatedly reproduced the predetermined num- 
ber of times. 

As is apparent, the number of times of repeti- 
tion may be one and may be arbitrary set by 
various switches or the like. Alternatively, the pre- 
determined number df times ftay be recorded on 
the index codes 506 or the dot code 502 fh ad- 
vance. 

A repetitive reproducing operation in this cSSe 
can be performed by repeatedly reading out in- 
formation from the data memory sfection 234 In 
FIG. 17 or 23. 

Note that the image pickup &&idh 204 in- 
cludes a monochrome image* pYcfcip elertient and a 
color Image pickup e!e i ttfertt generally obtained by 


mounting a color mosaic filter on an image pickup 
element section. In the above case, a monochrome 
imagre pickup section is used. Hpwever, reproduc- 
tion can b£ performed in different colors by sepa- 

s rating ctofors in tftb itoag£ pfaGSSsing section 460 
using a color image pickup element. In this esse, 
the color liqutg crystal 498 can be omitted. 

RG, 65 shows the arfafig^iVient of the image 
memory section #rt ima^e processing section 

io 460 in a case whej-$iri a gofer image pickup ele- 
ment is us^l. I@ldre spedficaJly, a signal input from 
trie color itnz$> pickup element is separated into 
data of the respective colors by a color separation 
circuit 608. thb^ala ate tfefepectively stored in 

rs rfienibries 61 ©A, fknti 51 0C. The data is theh 
seled:ea fey a malflplto(Q^ (MPX) 612, and subse- 
quent prbed^ing IS 0€Hentied. 

Gonsidfer A Second polarizing fitter 472 of first 
arid Second pt$larr2fri^ fifters 470 and 472 f6r pre- 

20 venting €peT6UlaV reflection. Slnee the same polariz- 
ing fitter as the^feeciffia polarizing filter 472 is used 
for the pbWteer portion of a color liquid crystal 
498, tile pblai^zer portion can dfeo defve as tHe 
second polarizing filter 472. Therefore, combining 

25 the first polarizing filter with the polarizing filter of 
the color liquid crystal 498, the seborid polarizing 
filter 472 can be omitted. In this <&s$, however, the 
angle of fhfe 6o\6t liquid crystal ort thd horizontal 
plane must be rotated to cut Components having 

30 the safhe aflrangeTneht as a direction corresponding 
to the second polartilng filter 472, i.e., cohnpohents 
in tite same dir&ttetf as that theredf. 

As $fiovfrn to Fl©, 6S&. even ff the color liquid 
crystal 4&Q is omitted, and R Q. and B light 

ss seurc&£ ctfris&ut^d by i£Ds like those shown in 
FIG. 6feB bjb used as a tight source 198 instead of 
a white light source, the color multiplex <Kft code 
502 can be read. More specifically, when the above 
code t corresponding to red Is to be teed, ortly the 

40 LEDs corresponding to red. of fife ftGB fight 
source t98, a^e turned on. When code 2 is to be 
read, only the LEOs corresponding to grSeh are 
turfed oh. Wtfn edde 3 Is to be read, only the 
LEDs dorres|!teWding to blue are turrted oh. With 

45 this dpeYatidh, a rfef reducing operation is pe?- 
formdd. 

In aQdition. ff&tsad of u&ing R, G, arid B LEDs, 
a white light source having color filters added to 
the respective tfortfons may be used as a light 

so source for the respective dolors. 

The same Effects as fhbse obtained by the 
arran^erhdht shown tt FIG. 62 can be obtained by 
using ft G, and B li^fit sources as the IHjltt source 
198, and controlling fie 0M/OFF operations of light 

55 sourops 6t a c&ibr safecfed 6y the index 6060 506. 
In adaitloR, tf the^paHhls fhcfbajfe fight sources 
for emMUftg light fiaving wavelengths In a plurality 
of narrbW bartds, a color liquid crystal ahd its 
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control circuit need nqt be used, and the apparatus 
can be reduced in cost and size. Especially, some 
LEDs emit light having wavelengths in narrow 
bands, e.g., wavelengths of about * 27 nm. If such 
LEDs are used, reproduction with narrower bands 5 
can be realized. 

A pen type information reproducing apparatus 
for stealth type dot codes will be described next. 

FIG. 67A shows a dot data seal 516 with a title 
on which an infrared emission paint dot code 514 10 
as a stealth type dot code is printed. This dot data 
seal 516 is obtained by printing, for example, a title 
in ordinary color or monochrome print by a printing 
machine or a printer, and printing a dot code below 
the title by using an invisible paint. As is apparent, 75 
since the dot code 514 of the dot data seal 516 is 
invisible print, ;i.e., transparent print, the dot code 
514 may be printed on the title as the visible 
information by using a transparent ink* as shown in 
FIG. 67B. If, for example, an ink-jet printer or the 20 
like is used, this print can be realized by using four 
inks, i.e., cyan, magenta, yellow, and black inks, 
and an infrared emission ink as the fifth ink, and 
printing and superposing them. 

FIG. 67A shows a case wherein the title is 25 
printed on a marginal portion of the stealth dot 
code. As is apparent, a visible dot code may be 
printed on the dot data seal with the title, and a title 
may be printed on a marginal portion. 

For example, as shown in FIG. 68, the pen 30 
type information reproducing apparatus for repro- 
ducing the infrared emission paint dot code 514 as 
such a stealth type dot code uses an infrared- 
emitting element 518 as a light source 198 be- 
cause the dot code 514 is printed in an infrared 35 
emission paint, and has an infrared bandpass op- 
tical filter 520 arranged in front of an image pickup 
section 204. * ; 

More specifically, when light in the infrared 
region is irradiated from the infrared-emitting ele- 40 
ment 518 onto the dot code 514, light having a 
wavelength in the infrared region, i.e., a given nar- 
row band, is reflected. In order to detect the inten- 
sity of the reflected light in the image pickup sec- 
tion 204, visible light information is separated 45 
through the infrared bandpass optical filter 520 and 
the reflected light is guided the image pickup sec- 
tion 204. 

Note that a plurality of paints for different emis- 
sion bands used to print the dot code 514 can be so 
prepared. If, for example, an imaging operation is 
performed while the characteristics of the band- 
pass optical filter 520 are gradually changed, this 
transparent print can also be multiplexed. 

Instead of incorporating all the functions of a 55 
reproducing system in a pen type information re- 
producing apparatus, ROM cards are generally 
used to add various optional functions to various 


devices, e.g., an electronic notebook, a PDA, a 
wordprocessor, a personal computer, a copying 
machine, a printer, and an electronic projector. A 
case will be described wherein the above functions 
are partly allocated to a card type adaptor which 
can be connected to a ROM card connector. 

FIG. 69 shows a case wherein a pen type 
information reproducing apparatus incorporates up 
to an image processing section 460, and an output 
from the image processing section 460 is supplied 
to a card type adaptor 524 via an output connector 
522. In this case, the card type adaptor 524 has a 
data processing section 462, a data output section 
464, a signal processing section 526 including D/A 
conversion, and an audio connection terminal 528. 
Reproduced audio information can be output, as a 
sound, from a speech output device 268. and mul- 
timedia information such as reproduced image in- 
formation can be supplied to an external device 
532 such as an electronic notebook via an l/F 530. 

More specifically, the card type adaptor 524 is 
connected to the ROM card connection terminal 
(not shown) of the external device 532 such as an 
electronic notebook which does not have a speech 
output mechanism such as a loudspeaker so as to 
receive multimedia, e.g., a dot coded image, from 
such a device which cannot perform a speech 
output operation. At the same time, the speech 
output device 268 such as an earphone is con- 
nected to the audio connection terminal 528 of the 
card type adaptor 524 to allow the user to listen to 
dot coded speech. 

As the external device 532, a video game ap- 
paratus which has recently been popularized in the 
homes, may be assumed. FIGS. 70 and 71 show 
the arrangements of card type (cassette type in 
this case) adaptors 524 for such video game ap- 
paratuses. FIG. 70 shows a case wherein a pen 
type information reproducing apparatus incorpo- 
rates up to a data processing section 462. FIG. 71 
shows a case wherein a pen type information re- 
producing apparatus incorporates only a detection 
section 184. A ROM 534 serves to store control 
programs executed by a CPU (not shown) incor- 
porated in a video game apparatus body. When the 
cassette is inserted, the control programs are load- 
ed into the apparatus body. A RAM 536 is used to 
store a processing result obtained by the data 
processing section 462. A memory control section 
538 controls the ROM 534 and the RAM 536 in 
accordance with instructions from the CPU in the 
video game apparatus body. 

In general, a video game apparatus incorpo- 
rates a high-performance CPU. Therefore, process- 
ing can be performed at a higher speed by causing 
the CPU in the video game apparatus body to 
perform part of the processing than by performing 
all the processing in the pen type information re- 
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producing apparatus. In addition, since the operat- 
ing section of the vide© game apparatus can be 
used as an Input &ottbh for various control oper- 
ations, a read star! designating switch such bs a 
touch sensor arid the like need not b$ arranged on s 
the pen type information reproducing Apparatus. 
Therefore, a reduction in the size of the apparatus 
can be realized, in tills case, a control program for 
processing assigned to the "CPU in the video game 
apparatus body or a eejitrot program for allowing 10 
the CPU in the apfjarafcis body $ntf the operating 
secflon of the video game ap£&ratus to control the 
pen type information reproducing apparatus and a 
user interface function tor operation is stored in the 
ROM 534. In a&fiSdh, Slice i loudspeaker, ait 75 
audio output terminal a monitor output terminal, 
and the like are arranged in the video game ap- 
paratus, these components can Be omitted from 
the pen type information reproducing apparatus 
and the card type adaptor. Therefore, a reduction 20 
in cost can be realized. 

An operation switch In the use of the card type 
adaptor 524 will be described next. 

An electronic notebook a$ the external device 
-• 532 generally has a slit to allow a card called a 25 

ROM card or an IC card to be mounted therein. 
& When a card type adaptor te inserted/moHnte^ In 
the slit characters or symbols written on a stifface 
: of the card type adaptor are seen through a trans^ 
*^ parent touch panel 566 off the Electronic notebook. so 
When a character or symbol wKtfon on the <sad 
v type adapter is touched, a corre^nding function 
is activated. For exrimplb, sdihe C&rd ; tyifa : ad&ptito 
allows a display operation on a display 582. 

In the c£&§ of the card type adaptor 524 for 35 
such an electronic notebook, as shown in FH3. 72, 
instead of arranging switches for the control sys- 
tem of a pen type information reproducing appara- 
tus 664, e.g., an operation switch for turning on/off 
the Rght source 198. characters or Symbols repre- 40 
seating these switches are Written at predetermined 
positions on a surface of the adaptor. 

In addition, since a keyboard Is incorporated in 
the external device 532 such as a personal com- 
puter or a wordprocessor, when the pen typS in- 45 
formation reproducing app&ni&is is coVihected to 
such a device, control can be p6?formed oh the 
device side without arranging control system 
switches in the card type adaptor 624. 

In the case of the external device 532 such as so 
a printer, which has dedicated control switches for 
its own operation but has rib other control system 
switches, control system swttchdS rhufct b& ar- 
ranged on the card type adaptor 624. For example, 
as shtfwn in H& 73, the card ty{& adTapibr 624 fs ss 
elongated to bb lontfbr th& & general card, and 
necessary switches 566 are arranged On a pdrtJbn, 
of the card tyffe idafcrtor 5^4, which intrudes? from 


the device 932 when the adaptor is inserted in the 
device. In this case, as the switches 566, tact 
switches, a fftfeh pahel, or the like can be used. 

An apparatus for printing a dot code will be 
described next* 

A reel seal «printing m^chihe 572 for printing on 
a i$el seal a dot code converted by a multimedia 
ihformatioh recording apparatus 570 from d^ta ed- 
ited t)y a perioral computer, a wordprocessor, or 
the like 668. as shown in FIG. 74, will be de- 
scribed. 

RG. 75 shows the internal arrangement of this 
reel sod) printing machine. 

A dot code from the multimedia information 
recording a£p£ratus &0 is temporarily stored in a 
memory 574, and L6b arrays 578 and §80 are 
turned on by an LID tlriver 576 in accottfanbe with 
the dot paftefa. Light frbm triesfc UEDs is gufdf§d 
offib a photosensitive sheet extending ffbm a pho- 
tosensitive paper reel 584 via rod lerises 882 ar- 
ranged in contact vvith the respective pixels. The 
timfrfg xtf emission is managed by a CPU 588 in 
accordance with the speed and position of the 
photosensitive sheet which are detected by a sen- 
sor 586. Similarly, the feed speed of the photosen- 
sitive sheet is controlled by controlling a driver 594 
for a motor for driving a roller 590 on the output 
stage. 

in order to protect the printed dot code, a 
surface coat seal 696 is added by the output stage, 
so that thb photosensitive sheet and the surface 
co£t seaf are simultaneously output in a bonded 
state. In this case, as a photosensitive sheet, print- 
ing paper, a film, or the like can 4& used. In this 
casd, a photbsen$rfive sheet is provided with its 
lower surface having adhesion properties. 

If an ordinary film or the like Is used as a 
photosensitive sheet, two types of dot oOdOs itfay 
be multiplexed by using a red LED array & fie 
LED array 576 and a yellow LED array as the %M> 
580. as show/i In FIG. 75. In performing a fftul- 
tipl^xing operation, a dbt coile having fwo ddiors 
may be formed by shifting th6 positions of tWo 
types of LEGs from each other. AlteMatively, two' 
types of LEEfe iWay be turned on at the saffie 
portion to forrri different colors so as to ^ertbrm 
fuKHer multiplexTn^. 

With the u$0 of a photosensitive sheet, the retel 
seal prihtihg machihe 572 Is Characterized in that 
not orfly a nl§8 resolution but also a low cost can 
be realized. Irv addition, Since the arYdh^itteht 6f 
the expbsure pbtfton uS#§ fedm&fict Let) #ra*rs 
withdtft t©qutfthg bxperisfve frrob&sstfig such as 
scahnirig with a fc&er or the like, the cbSVof the 
apparatus t&d be greatly reduced. Fofthgfrtidfe, tn 
thfc prinfirig rfuidiffie 6?2, since a cOMSbt tflte 
eptfdai fiath is arrahgfed, rfi# posrtfonTng flitolsioite 
for, otf.. the Itrtgft&s of mirrors are not required, and 
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problems in the manufacture can be avoided, un- 
like an apparatus using a laser or the like. 

For the sake of illustrative convenience, FIG. 
75 shows the LED arrays 578 and 580 and the rod 
lenses 582 arranged along the traveling direction of 
a photosensitive sheet In practice, however, these 
components are arranged along a direction per- 
pendicular to the drawing surface, i.e., the width- 
wise direction of a photosensitive sheet. As is ap- 
parent, such components may be arranged in the 
widthwise direction as well to form a two-dimen- 
sional array so as to form a large number of dot 
codes at once. 

In the above reel seal printing machine 572, a 
photosensitive sheet on which a dot code is printed 
is output from* the roller 590 in the form shown in 
FIG. 74. In this case, a white blank portion is 
preferably set at the boundary between the current 
data and the next data to allow, the user to visually 
recognize a portion for which a cutting process 
using a cutter or the like is to be performed. In 
addition, the length of a code which can be stuck 
varies depending on the size of a sheet on which a 
reel seal is to be stuck, i.e., whether the size of a 
sheet is A4 or B4. Accordingly, the printing ma- 
chine may be designed to variably change the 
length of a dot code which can be printed. In such 
a case, for example, the following control method is 
employed. For example, in accordance with a man- 
ually set sheet size, the timing at which a dot 
pattern in the dot pattern memory 574 is read out 
is controlled to adaptively change the length of a 
dot code. 

FIG.. 76 shows the , arrangement of a . word- 
processor incorporating a function of recording a 
multimedia dot code. 

This arrangement is the same as that of a 
general wordprocessor except for a multimedia in- 
formation recording processing section 598 for 
generating a dot code with respect to data edited 
on sentences. More specifically, the following com- 
ponents are connected to a bus 602 extending 
from a CPU 600: various ROMs 604 for programs, 
a character generator, and the like; a RAM 606 as 
a work area; a calendar 608; a bus control 610; a 
CRT control 616 for displaying data, developed in a 
video RAM 612, on a CRT 614; an I/O control 620 
for a keyboard 618; a disk control 624 for control- 
ling an FDD 622; a printer control 628 for control- 
ling a printer 626; various l/Fs 630; and the like. 

The multimedia information recording process- 
ing section 598 is designed to exclusively access 
the bus 602. The contents of the multimedia in- 
formation recording processing section 598 are ba- 
sically the same as those of the multimedia in- 
formation recording apparatus 570 shown in FIG. 
74. That is, data supplied from the bus 602 via a 
bidirectional I/O 632 is separated into character, 


graph, and picture data by a separation circuit 634, 
and the respective dati are properly compressed 
by compression circuits 636 and 638 and syn- 
thesized by a synthesis circuit 640. Meanwhile, 

s character, picture, and graph layout information is 
directly input to the synthesis circuit 640. An error 
correction code is added to this synthetic data by 
an error correction codb addition circuit 642, and 
processing such as interleave processing of the 

io data is performed in a memory 644. Block ad- 
dresses and the like are added to the data by an 
address addition circuit 646. The data is then mod- 
ulated by a modulation circuit 648. Thereafter, 
markers are added to the data by a marker addition 

75 circuit 650, and a title and the like for the dot code 
are synthesized with the data by an edit/synthesis 
circuit 652. The size of the dot pattern is changed 
by a dot pattern shape conversion circuit 654. The 
resultant data is then returned to the bus 602 via 

20 the bidirectional I/O 632! 

The printer control 628 controls the printer 626 
in accordance with the data returned to the bus 
602 to obtain a printout like the one denoted by 
reference numeral 656 in FIG. 76. 

25 As shown in FIG. 76, the printout 656 is ba- 

sically designed such that a picture 660 and a 
graph 662 are added to sentences 658 written 
(typed) at a wordprocessor, and the contents of the 
sentences 658, the picture 660, and the graph 662 

30 are printed as a dot code 664 at a predetermined 
position, e.g., a lower position. 

With this printout 656, the user who receives 
the printout 656 directly or in facsimile can load the 
document 658, the picture 660, and the graph 662 
35 into the user's wordprocessor by reading the dot 
code 664 with the above pen type information 
reproducing apparatus, and can arbitrarily edit 
these data. 

The multimedia information recording process- 

40 ing section 598 may be realized by software pro- 
cessing performed by the CPU 600. 

In addition, the multimedia information record- 
ing processing section 598 may be incorporated in 
the printer 626 instead of being mounted in the 

45 wordprocessor. That is, the printer 626 may per- 
form recording/modulation of input information such 
as font and graph information to perform a printing 
operation. In this case, the multimedia information 
recording processing section 598 may not be in- 

50 corporated in the printer 626 but may be provided 
as a card type adaptor. 

When the contents of a printout are to be 
transmitted in facsimile, since the resolution or 
definition of a facsimile is also specified as Gil or 

55 Gill, the dot pattern shape conversion circuit 654 in 
the multimedia information recording processing 
section 598 may perform conversion in accordance 
with such a resolution, i.e., change the size of the 

40 
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data, as well as conversion In accordance with the 
resolution of the l^hW*26; 

FIG. 77 shows an arrangement for a case 
wherein the function of a multimedia Information 
rSdorditfg prdtistssjftg seSiujn Is fhcoJiiorated in en 
optical crying riYadhine* 666, eo that When a copy- 
ing 0pefatTon r$ ^itM^ W cdrttSnts of an 
original are copied oltfo 6 sheet, and at the samfc 
time a dot cote cdr^j^fiteljfe to the contents is 
printed at a pred^hntfl^d jjositioh on the sheet 

That is, s&ftflsr lb a gertWl^t popying machine, 
the opticaf copylhQ machine 6^6 Wciutfe$ ah oHgi- 
nal t^bte €[66, a Wimp ^7^rr^fr^& 072. a len$^74, 
a phtftosensitive driift 0^;ati9 tHfc like afrd i&rves 
to copy an Image 6rf ih orfglnat drito a sheet 

Furthermore, in the opticaT dopyfng me&iih'e 
666 of thte erntKjdJrhent, a Iwtff pttefti 678 is in- 
serted in the optibffi pafh fh front of fhfe fens 674 to 
splfit fight, and a spnt fi^ht beam is guided to an 
Image picftup elemeftt 6ffi sUch as a iihe sensor 
via an optica! part 680V A siqnal from the image 
pickup elemeht 682 is amplified by an amplifier 
684 and undei^o&s varidtis analog processes. 
Thereafter, the resultant i^ converted into digi- 
tal data by Itn A/0 t*rtv£ft£r 686 and recorded in a 
memory 668. Irhage area determination, data char- 
acter recognition, and the like are performed With 
respect to the data recorded oh the rriemory 688 
by an image area determination and data character 
recognition circuit 680: W fhis case, irtiage area 
determination can be^rfdrmed by tSsihg the t&ft- 
nique disclosed fh Japlite$e P$mi Aj^catidfi No. 
5-163635 filed by the preset applicant 

The datfi having undergone frt&ge area deter- 
mination, cfetfa character recognition, and the like ts 
comfHressed by cofhpressfen drcdlt 692. In ihis 
case, since character data, picture date, graph 
data, and the fike require different compr es sion 
schemes, the respective data are corripressed &b- 
cordihg to the bdrrespbnding compression 
schemes. Thereafter, the resultant data and layout 
information are synthesized by a data synthesis 
circuit 6394. After an errdr correction code is added 
to the synthetic data by ah ehror correction code 
addition circuft 696. and the resultant dlta is stored 
in a memory 698, and fJVojcessihg sucft .& inter- 
Iddvl ptebee^Hg is gMdrfiiea dgairi. Atfdffeses 
aft added to the data by an address adclftion 
circuit 7b0, £hd the latent data is iftSdifl&t&i by 
a modulation circuit 702: Makers are ftieh t&fefd 
to the d&tit by a marker addition circuit 704. The 
dot pattern form is converted by a dot pattern 
shape conversion circuit 706. A Ught-emfttirfl ele- 
ment driver 708 causes a li§fii-6mittxhg element 
710 to emit light in accordSihCe with the fibt pattern. 
At the same time, a mirror shuftSt 712 ts m§& io 
guide the R&ttt froth m Hgftt^mitiiHg elemerft 710 
to tfie lens 674 artd the pftbtosensftive drum $3%. 


In addition, as described above, when the data 
is to be transmitted in facsimile, a facsimile resolu- 
tion is selected by a feosinffilje resolution selection 
section 714, §nd the (4happ <sf the ddt oode pattern 
5 is changed by, the dot pattern shape conversion 
circuit 708 m eoeordanfee with the selected resolu- 
tibK ■ ■ ■ ; ■ ■ • ; 

In the Im^p area xieiemi'nation and data char- 
acter recogrittion tirmt 690. a character may be 
10 handled $T is M&ify fmagp, 0mSrttf- tiihstry 
image compression pro^Slrfg sljch as MR or MH 
m iy be peftcfrifted;^^^ eferacftr fecogni- 
tion mdy mg^tlfiM » 6bh4eW a character into 
a d&e Is ^iSSmS^^k, which is used in a 
general wo^racesStir* and the code may be com- 
pressed by a cdmp^sioh Sdheme such as Lem- 
pel-Ziv coding, if comt>r^siof» Is performed 1n this 
m&nndr after ^ari£&£r recdghltfah and ASCII code 
cttnvereibn, the* cdrtfpressjon fafip considerably in- 

20 creases, pod a larger aq|6urft of data can be re- 
corded with fewer dot codes accordingly. 

Owing tf> file profeesSing speed of the signal 
processing system, in'prtKtirig ad6f code, ah origi- 
nal image is wrttteh/ex£6sed first onto the pho- 

25 tosehsitive drum 676, arid the mirror shutter 712 is 
then ra&ed to c&i&eWe (©h^mitdng element 710 
to fewfite ahd P/Wtt the dot oode on the drum. 
AKeratiyeiy, a ^ dbt t^e msiy be gener^ed by the 
first original scan as the pr^scan, and an original 

30 image and tfie dot cade m£y be wrttteh on the 
photosensitive drum 676 by the second original 
scfifit fl& the prb^^Mti spofed of the signal *pro- 
ce&firifef sy^fS ifi&fetim ti\%e future, propesang 
heed not bd perfomr^d a plurality of mAWbir of 

35 times in tHfe efdhridr. If. ftbWev^r, Ah original is 
pmb«i sidi&w^ys *0 t^Sffila tetjie SB6 or placed 
upside down, prbces^n^ tHu^t be performed a 
pluraity of number of tirrfes to obtain a copying 
result haviifg a dot bode prinfed at a lower potion 

40 on a sheet in the IdfigitudifierHirection, as Indicated 
by referehce numeral $S6. 

78 shows ah arrahgement for a case 
wherein the present invention fs applied to a digital 
copyiftgi macj^he 716- ?h£ same reference nlh 

45 morals in FIG. 78 fl^no^ p^Hi having the satoe 
functions a^ th^e fri Fl& 77. tn fills arrdifgfhfefft, 
an optical mirror |s designed to 13 movfed in tie 
inpdt sectioh. fiowev&>. a line senSOr iViay be 
moved to read- £n bftginal. 

so MorS speclfJtfeny, in this digital copying ma- 
chine 716, £ dSt c6(5le' whose tfiape has been 
ohan^ed by a clot t&Wn 3\$pe conv^ioh circtift 
706 iri flfe Wiahrier is syttftesteed with origi- 
nal ima^e data Coated in a' memory 688 by an 

66 editfeyn^^ <5)r&i1f 718. and the r&uftaorrf ddm is 
prlrtted dig. by a 'prihtet fSO. Sin66 sue* a digital 
crying tn§6t*56 h^lhe m'enlory g§B v ^1 dot (M6 
can be (^iWed at any pcJsttfon oh a Sheet by one 
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scan operation instead of performing processing a 
plurality of number of times as described above. 

The flow indicated by the broken lines in FIG. 
78 will be described next. This flow indicates that 
only a dot code is read from an original on which 5 
the dot code is printed together with sentences and 
a picture, and a document as a combination form 
of the dot code and the sentences and the picture 
reproduced from the dot code is printed out/ in- 
stead of generating a dot code by reading an w 
original in the above manner. 

More specifically, a dot code is read from an 
original by an image pickup element 682 and re- 
corded in the memory 688 upon A/D conversion. 
The output from an A/D converter 686 is also input is 
to a dot code-reproducing unit 722. The dot code 
reproducing unit 722 includes, for example, the 
circuit arrangement after the scan conversion sec- 
tion 186 in FIG. 17, and can reproduce sentences, 
a picture, and a graph from a dot code. An image 20 
of the dot code stored in the memory 688 is 
supplied to the dot pattern shape conversion circuit 
706 without any modification. After the size of the 
dot code is changed, the dot code is input to the 
edit/synthesis circuit 718. The edit/synthesis circuit 25 
718 adds the dot code, supplied from the dot 
pattern shape conversion circuit 706, to the sen- 
tences, the picture, the graph, and the like repro- 
duced by the dot code reproducing unit 722. The 
resultant data is input to a printer 720 to be printed 30 
out. 

With this operation, since the time required to 
scan the original is the time required to read this 
code portion, the processing time can be short- 
ened. In addition, when sentences, a picture, a 35 
graph, and the like are enlarged or reduced, a dot 
code can be printed without changing its size re- 
gardless of the enlargement/reduction processing. 

FIG. 79 shows a case wherein a pen type 
information reproducing apparatus is also used as 40 
an input section for data such as character and 
picture data. 

More specifically, a signal from an image pro- 
cessing section 460 of the pen type information 
reproducing apparatus is input to a multimedia 45 
information recording apparatus 724. In the mul- 
timedia information recording apparatus 724, the 
input data, i.e., the imaged data, is input to a frame 
memory 728A or 728B via a selector 726. In this 
case, the selector 726 performs selection such that 50 
one frame is loaded in the frame memory 728A, 
and the next one frame is loaded in the frame 
memory 728B. The image data loaded in the frame 
memories 728A and 728B undergo removal of fens 
distortions such as aberrations at peripheral por- 55 
tions in distortion correction circuits 730A and 
730B. Thereafter, the data are input to an offset 
amount detector 732. The offset amount detector 


732 calculates a correlation between images re- 
spectively loaded in the frame memories 728A and 
728B to calculate the direction and amount of an 
offset therebetween, thereby allowing overlapping 
portions of the two images to be superposed on 
each other as a picture when the two image are 
synthesized with each other. As this offset amount 
detector 732, the detector disclosed in, e.g., Japa- 
nese Patent Application No. 5-63978 or 5-42402 
filed by the present applicant may be used. One 
image, i.e., the image loaded in the frame memory 
728B, is interpolated by an interpolation processing 
circuit 734 in accordance with the detected offset 
amount and enhanced by an enhancer 736. There- 
after, the image is synthesized with the image 
loaded in the other frame memory 728B by an 
image synthesis circuit 738. The resultant data is 
stored in an image synthesis memory 740. 

The next one frame is loaded in the frame 
memory 728A, and the same processing as de- 
scribed above is performed. The image loaded in 
the frame memory 728A is then interpolated. 

Subsequently, these operations are alternately 
performed to obtain a large frame. 

The pen type information reproducing appara- 
tus is essentially designed to read a small code 
like a dot code. Therefore, the imaging area of the 
apparatus is very small. When the apparatus hav- 
ing such a small imaging area is to be used as a 
scanner for reading images of characters and a 
picture, the image must be loaded by a plurality of 
number of times, and the read images must be 
pasted to each other. For this reason, in this em- 
bodiment, a plurality of frame memories are ar- 
ranged, and offset mounts are detected, and im- 
ages are pasted to each other upon correction of 
the offsets. 

The data recorded on the synthetic image 
memory 740 undergoes image area determination 
in an image area determination circuit 742. Of the 
data, character data is subjected first to character 
recognition in a character recognizing circuit 744 
and then input to the multimedia information re- 
cording processing section 598, and image data is 
directly input thereto. The data undergoes process- 
ing such as compression in the multimedia in- 
formation recording processing section 598 and is 
converted into a dot code. The dot code is intro- 
duced to the reel seal printing machine 572 de- 
scribed above. Alternatively, the data may be input 
to an external device 532 such as a personal 
computer or a wordprocessor via an l/F 746 instead 
of being input to the multimedia information record- 
ing processing section 598. 

Note that the pen type information reproducing 
apparatus may have two terminals as output termi- 
nals, i.e., an earphone terminal and a terminal for 
outputting an image, or may be designed such that 
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one connector is manually switched between a 
sound output system and an image output system. 

FIG. 80 shows a modification of the apparatus 
shown in FIG. 79. FIG. 79 shows the case wherein 
the area of the Image pickup eeotfon 204 in a dot 
code read oparatton Js tfie same as the imaging 
area of the image pickup section 204 when It is 
used as a scanner. In this embodiment however, 
the image formation optical system 200 is changed 
such that a wide-arigle mode is set' when the image 
pickup section 204 is used as a Scahner. while a 
macroscopic imaging operation is performed when 
a dot code is to be read. 

More specifically, the image formation optical 
system 200 is constituted by a zooip or bifocal 
lens group used in a gSh@&J camera, and designed 
to switch between the wide-angle modfe and the 
macroscopic mode by sliding a leiis fiaftrgf 746. 
The image formation optical system 200 has a 
scanner switch 750 which is turned on upon clos- 
ing of a contact point Wheri the ierts barrel is 
contracted. While the ecanrter switch 750 is on; the 
control section 212 stops the operations of the data 
processing section 462 "and th£ daft output section 
464 to allow the image pfckup section 204 to be 
used as a scanner. While the scantier fewitdh 750 is 
off, the control section 212 operates the^e compo- 
nents to allow the image pickup section 204 to 
perform a macroscopic ojjeratibh. 

When, the image formation optical system 200 
is set in the wide-angle fnbdd, the imaging area is 
decompressed. If th^ focai depth is ± 120 urn and 
the image magnification is 0.0& at fh& time, foe 
depth of field is ± 19 mm. Evert ff a fchafce bf fh^ 
apparatus occurs in the loftglfucBnal direction, no 
problem Is posed with this depth of field. 

In addition to the scheme of sliding the tens 
barrSf 748 to switch between the widd-angfe rruxfe 
and the macroscopic mode, thfs rrrodfflfiafioh c&n 
be realized by using a scheme of Ihtercfrangfng 
lenses, i.e., mounting a tenfe for the macroscopic 
mode in £Jace of a fens for the wide-ang& mode. 

FIG. 81 shows a case wfte/Oin a card type 
adaptor 524 incorporates two 0rdc&&rid §£€tion$: 
a data processing Sectidh for output information 
corresponding to a dot c6de, read by the peh type 
informatioh reproducing apparatus shown in FIG. 
69, to an external device 532 such as a pfefgbnal 
computer or a wordpro6lasson and a data jproteess- 
ing sedtidn for *ffibfdh<j tift£®& ahd gefterafiftg a 
dot codd when the peh typfe information ?§pn&luc- 
ing apparatus shown In Fid. 7d is u3& as a 
scanner for Sentences, pictures, and Inlaws. Tfiat 
is, hG. 81 shows the card typfe adaptor $24 incor- 
porating the data processing Section for tfie Scan- 
ner ahd die data processing sectfth for a dbt Ctfde 
read operation. 


Referring to Ft©. 81 , selectors 752 ahd 754 
serve to swil&h bfttvveah {he data processing sec- 
tion for the Se£nH$r 6hd the data processing $66- 
tten for 6 dot; code read operation. This switch- 
6 ing/seiedting oper&tibh may be manually per- 
fMri^/W may l& IrtfeHopK^ with the ON/OFF 
bp&af&ft 8 m&ntet £witbh 7S& like die one 
shown In P\& 80. Alternatively, this operation may 
be directly performed from the external device 532 
io sftife: *" '*■'*'■ ' 

An image Synthesis processing circuit 756 has 
the functions of the selector T2B t the frame memo- 
ries 728A &td 728B. 1he dlsteitfon Correction cir- 
cufts 730A end 79DB. thie off^el amount detector 
75 752, fiie inm^olatten ptdc^^ng circuit 734, the 
enhafiddr 736?. rinS ffi6 ima§e syrithe&s circuit 738 
shbv/ft in R®v :70. An xaut^ut^ processing circuit 758 
serves to m6ich data (to b& diitpot) with the format 
of me exter*al> < tfevft& S3& 

20 An embodiment irt whieb the information of a 
read dot code IS olrtp at to an electronifc projector 
Will tee described <#xt : M sN&Wi in FIGS. 82A and 
82B; a dot codfe i$ scanned % a pen type rnforma- 
tidh rejkddUfcffig #palratus 760, ahd the original 

25 informatioh is re^ordd by ah output processing 
se60on 762. The ^fdmlaiidh is then Input ^ the 
R(3B input terminal of a piojebtor 764 or the video 
input terminal &f ah electronic OHP 766, thereby 
pi^fetihffir the information on a screen 768. 

30 Inihife case, fh& pen type Information reproduc- 
ing apparatus 760 incorporates the arrangement 
from the detection Section 464 to the error correc- 
tion section 104 &i th6 arrangement of the re- 
producing syifem £hown in FfQ. 17 or 23. The 

35 output processing SSdtioh 762 Incorporates the ar- 
rangement after the d&ta Separation s&tien 196 
arid dttier processing bTrclrits. 

FIG. 8$ sfioWs -me actual an*arigemerit of tite 
outpc/t processing Motion 762. fAore specifically, 

40 multimedia information from <he peh typ# r ^forma- 
tion reproducing apparatus 760 Is separated into 
image mftfrmatioh, graph InfQmiafiort, character in- 
formation, speedh information , anil header infor- 
nrtafion by the data separation section 196. The 

45 image information, graph Ihformafidri, and character 
information are de^omprei^b by the decompres- 
sion {MaWdltg scions ^ 248. There- 
after, fhe image fnf^irfh^^ alhd the gr^ph iriforma- 
tion ufid^rgo inteVpoT^Boi^ ^ocefeslng in the data 

so interjioiaidn d&cqlts 5^ iifid Hfe character 
infohnation uh^ei^oes PoL prdces§ihg ih thei POL 
processing s^ctioA i?46. tfce ^fiagrf ffifthttsition, the 
grdph iftfohtatrdn, and tfie ch^raca^r inforniation 
haVihg i/hd^Q^ne fntdfpotetiQh arid Pffl. phoc6$s- 

55 ing &re synthesized by a synfhe?f$ circuit 260. and 
the resultant dat^ Stored ih a memory Tto. The 
data stored Ih this rinerfiory 770 Is data which c&h 
be prdjected on th^ screen 7S8. This data is D/A- 
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converted by the D/A conversion section 252 and 
output to the projector 764 or the electronic OHP 
766. In this case, the memory 770 is controlled by 
an address control section 772. Meanwhile, the 
speech information is directly, decompressed by 
the decompression processing section 256 and in- 
terpolated by the data interpolation circuit 258. The 
resultant data is D/A-converted by the D/A conver- 
sion section 266 and output to a loudspeaker 776 
incorporated in or provided out of the projector 764 
or the electronic OHP 766 via a selector 774. 

The data as a speech synthetic code is con- 
verted into speech by the speech synthesis section 
260 and input to the D/A conversion section 266. 

Assume that sentences are directly read during 
a presentation, as needed. In this case, sentences 
are recognized from a character code for display 
by a sentence recognition section 271, and the 
sentences are converted into speech by the 
speech synthesis section 260. Finally, the speech 
is output from the loudspeaker 776. 

In this case, since any special speech syn- 
thetic code for recitation need not be recorded, a 
larger amount of information can be set in a dot 
code. 

Furthermore, in this case, a projector selecting 
means 778. is arranged to select th$ projector 764 
for the high-definition television scheme or only the 
NTSC scheme, thereby allowing connection of any 
type of -electronic projector system. That is, the 
manner of assigning character sizes in the memory 
770 and the like change depending on an elec- 
tronic projector system as an output system. For 
this reason, the processing in the data interpolation 
circuits 240 and 244 and the PDL processing sec- 
tion 246 is changed, or a clock signal CK supplied 
to the address control section 772 or the D/A 
conversion section ,252 is changed by a reference 
clock selection section 780 depending on selection 
by the selecting means 778. 

In addition, in the operated state of an elec- 
tronic projector such as the projector 764 or the 
electronic OHP 766, for example, as shown in FIG. 
83, the user may want to perform a selective 
projecting operation, e.g., projecting only sen- 
tences, a picture, or a graph. In such a case, the 
user can select an operation through an output 
control section 782. Alternatively, information des- 
ignating projection of only sentences, a picture, or 
a graph is written, as header information, in a dot 
code in advance, and the user can select a portion 
to be output in accordance with the header in- 
formation through the output control section 782. 
An output editor section 784 performs a cutting 
operation of projecting a specific portion in accor- 
dance with selection by the output control section 
782, and causes the address control section 772 to 
access the corresponding portion in the memory 


770, thereby causing the memory 770 to output 
data for projection. In addition to such area division 
processing, the output editor section 784 can per- 
form decompression processing of part of the sen- 
5 tences or only the picture, and edit processing of 
focusing some of the sentences or only the picture 
portion and decompressing the focused part. In 
order to perform such processing, an input section 
and a display section are preferably arranged in 
io the output processing section 762 to perform pro- 
cessing such as graphical user interface, thereby 
allowing the user to actually designate a portion to 
be decompressed. 

Speech is input as a dot code and output from 
T5 the D/A conversion section 266. In addition, speech 
from an external microphone 786 can be selected 
by the selector 774. 

Note that only the detection section 184 may 
be arranged in the pen type information reproduc- 

20 ing apparatus 760, and the scan conversion section 
186 and the subsequent components may be ar- 
ranged in the output processing section 762. In 
contrast to this, the pen type information reproduc- 
ing apparatus 760 may incorporate components up 

25 to the data separation section 196 so that sepa- 
rated data can be sent in some form to the output 
processing section 762. In practice, the size of the 
pen type information reproducing apparatus 760 is 
preferably minimized in consideration of the fact 

30 that the apparatus is held with a hand of the user. It 
is, therefore, preferable that only the detection sec- 
tion 184 be arranged in the apparatus, and subse- 
quent processing be performed by the output pro- 
cessing section 762. 

35 FIG. 84 shows a case wherein data is output to 

a copying machine 788, a magnetooptical disk 
drive (MO) 790, and a printer 792 instead of the 
above electronic projector. An output processing 
section is incorporated, as hardware or software, in 

40 a personal computer or the like 794. FIG. 84 shows 
a state wherein an output from the output process- 
ing section is supplied to the copying machine 788, 
the MO 790, and the printer 792 online or offline 
using a floppy disk 796 or the like. FIG. 85 shows a 

45 case wherein the output processing section is de- 
signed as a card type adaptor 800 to be mounted 
in the printer 792 or an electronic notebook 798. 

FIG. 86 shows the actual arrangement of the 
output processing section 762 in this case. 

so Similar to the embodiment of the projector de- 

scribed above, multimedia information is input and 
separated into image information, graph informa- 
tion, and character information by the separation 
section 196. These pieces of information are re- 

55 spectively decompressed by the decompression 
processing sections 238, 242, and 248. The image 
information and the graph information are interpo- 
lated by the data interpolation circuits 240 and 244. 
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The character information is subjected to PDL pro- 
cessing in the PDL processing section 246. The 
pieces of information are then synthesized by the 
synthesis circuit 250 and stored in tfie memory 
770. The memory 770 te controlled by the address 5 
control section 772. The readout data is output to 
an edit monitor 804 via an interposition section 802 
and the D/A conversion section 252 to check data 
to be actually output. Note that this edit monitor 
804 may be omitted. io 

The data read out from the memory 770 is also 
input to a synthesis section 806. A coding section 
808 converts the multimedia information frbm tffe 
pen type information reproducing apparatus 760 
into a dot code again, an output adaptive interpola- is 
tion section 810 performs output interpolation of 
the dot code in accordance with the resolution of 
the printer 792 or the like, to which tfie dot code Is 
to be output, and this synthesis section 806 syn- 
thesizes the resultant data with the data from the 20 
memory 770. That is. the synthesis section 806 
adds a dot code to sentences and a picture and 
outputs the resultant data to the printer 792 or the 
copying machine 788 via an l/F 812. 

When information is to be output from the 25 
printer 792, an output selecting means 814 auto- 
^ matically set a resolution upon recognition of the 
J ^ type of the printer 792 connected to the output 
section 762. When information is to be transmitted 
offline using the floppy disk 7§6 or the like, sirice 30 
th<§ type of a printer cantfdt be recognized, the 
> resolution is Set manually. 

in this arrangement, sentences are directly 
copied or printed, tfH&fe&s a dot code cart be 
output in accordance with the resolution 6f a me- 35 
dium to which the dot code is to be output 

When the output section Is to be connected to 
the electronic notebook 798, since no ddt code 
input to the electronic notebook 798, no system for 
recording a dot code is required. The arrangement 40 
is almost the same as that shown in FIG. 69. 

■ FIG 87 shows an embodiment indudihg a for-. , 
mat conversion section 6l6 for converting the for- 
mat of data in accordance With each apparatus 
type so as to cope with the current situation that 45 
different types of wordprbc&sscfcs employ diffejfent 
data formats. The format conV^rilon saotiBrt 816 
has wordprocessor select sWftches as apparatus 
type selecting means 818. The format cbnyersfdh 
section 816 reads a dot code fhrbugh a pSh type so 
information reproducing dtfparatds 760, converts 
the data in accordance wfth selecfion by the ap- 
paratus type selecting meaiis 6t8, and inputs the 
resuitdnt data to a wordprocessor 620. 

PIG. 88 shows the actual Idrrah^enrtent of fh& 55 
format convfeHidh se&ion 816. That fe, after data 
are respective processed by data Intdrpolatfdft 
cirfcuitfe 240. 244. and 258, a PDL processing sec- 


tion 246, and a speech synthesis section 260, the 
formats of the respective data are converted by 
format conversion cirbdfts 622, 824, 826, and 828 
in accordance with setettiph by the apparatus type 
setetstin£ means lE(te, 

FIG. 89 shows a system for transmit- 
ting/recefVlng a Sheet (to be referred to as mul- 
timedia paper hereinafter^ oh Which a dot code Is 
recorded, in facsimile. In this system, a dot code 
generated t>y a multimedia Information recording 
unit 830 for facsihiile is printed out by a printer 792 
and transmitted tfpfti a trfirfsti^on-side facsimile 
832 to a receptidrtefa© fafeStoftite 634 via a tel§- 
phorte lirtb 836- tfte fecepfiofVstde facsimile 884 
receives this MorTh^tiOfl, restores it to the informa- 
tion oh the sheSt aftd reproduces toe dot code by 
using a pen type formation reproducing appara- 
tus 838. 

As shoWn in FIG, 90, tfie multimedia informa- 
tion recording unit 880 for fasctmiie is constituted 
by a muttimedla information recording drift 840, a 
dot pattern £hape cdViv^Tslon circuit 842, a fac- 
simile s^lecflhg hie£hs 844, &h® a synthesis/edit 
circuit 846. The multimedia information recording 
unit 840 includes dompofients up to the marker 
adcfifiSn &£ctibh 162 tn the anrangamertt of the 
recording system ste&Wn in FlS. 15. The syhthep 
sis/edit circuit 846 corresponds to the synthe- 
sis/edit processing sectidn 184. The dot pattern 
shajSS <^hveS^ : c^ift 842 aftd the facsimile se- 
leclirtg ^ean^ B44 biwespohd fc the dot pattern 
shap$ conversion tffctoh 706 and the facsimile refe- 
blutfdh selection sefcfidn 714 in FK3S. 77 and 78. 

tn this c&b. When line cbnngbtTon Is performed 
by the transirfBsioft-sfde facsimile 832 with fespdct 
to the receiSBJQrn-^(j& te<&&hire 834 via thd tele- 
phone fine 836, data indicating a terminated state 
is seftt from the rec^tpfton-side fac&iftile 834 to tfie 
trariami^dh-si^ This date is sup- 

plied to th&:1«fesimtte selecting means 844 mafo- 
ually or directly tb select a facsimile resolution or 
resolving povter. The dot pattern shape conversion 
circuit 842 thSh changes the- shap^ of the frStdm 
itself in &cc6Kteftc& wtth the i\ie of the clot code 
pattern or the 6f data which can be written 

on one line. The tesuttarit data is synthesized with 
the thforrftatigo on the sheet by the syhtheslsfedit 
circuit 846, arid the synthetic data is printed out by 
the tfrintfer 792. mfeitf ^tfBhg multimedia pafter 
to be transmitted th fafcsimite. 

FIGL 91 shovfe a facsfirhile-incorporated mul- 
timedia Irtfomtiatidn fecordW|i unit 848 in wtffch all 
the above pro$d&£riQ Is alitorfiated, and evert the 
fa^fmile transmlslibn/reception means Is incorpo- 
rator. 

fh Ms case, rasolvlng power informafion on a 
faCstffttfd of the dOfer party & checked upon fine 
connection via k tetefrhone line 836, the shape of a 
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dot pattern is optimized by using the information, 
and the dot pattern is synthesized with information 
on the sheet to be transmitted. 

FIG. 92 shows the arrangement of an overwrite 
type MMP card recording/reproducing apparatus 5 
for recording/reproducing cards (to be referred to 
as multimedia paper (MMP) cards hereinafter) on 
which dot codes are printed, as shown in FIGS. 
93A and 93B. 

In this recording/reproducing apparatus 850, an 10 
MMP card 852 inserted into a card insertion slit 
(not shown) is conveyed to a dot code detection 
section 856 by a card conveyance roller section 
854; a dot code written on the lower surface of the 
MMP card 852 is read; the read information is 75 
converted into the original multimedia information 
by a data code reproducing section 858; and the 
resultant data is output to an l/F or a data separa- 
tion section .(not shown). That is, the dot code 
detection section 856 corresponds to the detection 20 
section 184 in the arrangement shown in FIG. 17 or 
23, and the data code reproducing section 858 has 
the circuit arrangement including components from 
the scan conversion section 186 to the error cor- 
rection section 194. Note that the dot code detec- 25 
tion section 856 includes image pickup sections for 
the upper and lower surfaces of a card. Of these 
image pickup sections, the one corresponding to 
the lower surface of the card is used as the image 
pickup section 204, in the detection section 184. In 30 
addition, in this case, the MMP card 852 has a dot 
code recording area 852A on its lower surface, as 
shown in FIG. 93A. Images such as a title, a name, 
and a picture are recorded on the upper surface of 
the card. 35 

This recording/reproducing apparatus 850 re- 
ceives information other than the information al- 
ready written ,on the card from, e.g., an external 
personal computer or memory unit via an l/F 860. 
Information to be written, as a dot code, on the 40 
lower surface of the card is supplied to a data 
synthesis/edit section 862 and synthesized with 
information reproduced by a data code reproducing 
section 862. If, for example, new information dif- 
ferent from past information is input from the l/F 45 
860, the address is updated to the next address to 
be newly added to the data. If data is to be partly 
changed, only the portion to be changed is re- 
placed, thereby performing synthesis/edit process- 
ing of the data. The information having undergone so 
synthesis/edit processing in this manner is input to 
a code pattern generation section 864 and con- 
verted into a dot code. The code pattern generation 
section 864 has an arrangement like the one shown 
In FIG. 15. The code pattern generation section 55 
864 synthesizes and edits a generated dot code 
and data (to be printed) other than a code from the 
l/F 860, and supplies a printing section 866 with 


the data to be printed. This printing section 866 
also receives picture pattern data on the upper 
surface of the MMP card 852 from the dot code 
detection section 856, and prints the data on the 
upper and lower surfaces of a card having no data 
printed thereon and fed from a paper feed cartridge 
868. The new MMP card is then conveyed to a 
card discharge slot (not shown) by a card convey- 
ance roller section 870 to be discharged. In printing 
data on the upper and lower surfaces of a card in 
the printing section 866, data may be printed on 
one surface first, and data is then printed on the 
other surface after the card is reversed. Alternative- 
ly, data may be printed on the upper and lower 
surfaces of a card at once. 

On the other hand, an old card passes through 
the dot code detection section 856 and is coated 
with, e.g., a black paint-out ink by a paint-out roller 
872. The card is then discharged with the record- 
ing area 852A being blacked out. As a result, the 
original card which has been painted out can be 
returned to the user. Therefore, there is no pos- 
sibility that the old card is misused. 

As described above, according to the overwrite 
type MMP card recording/reproducing apparatus 
850 of this embodiment, when a card on which 
information has already been recorded to some 
extent is inserted in this recording/reproducing ap- 
paratus 850, the information is read and combined 
with newly added information to issue a new card. 
It seems to the user that an old card is discharged 
after data is added thereto. Since the old card is 
left, the card is returned to the user. Therefore, a 
card is replaced as if an overwrite operation were 
performed. 

FIG. 94 shows another arrangement of the 
overwrite type MMP card recording/reproducing 
apparatus. This recording/reproducing apparatus 
874 is basically the same as the record- 
ing/reproducing apparatus 850 shown in FIG. 92. 
The recording/reproducing apparatus 874, however, 
is an apparatus used when an old card need not be 
returned to the user. Therefore, in the record- 
ing/reproducing apparatus 874, a shredder 876 for 
shredding an old card is arranged after the dot 
code detection section 856. 

FIG. 95A shows still another arrangement of 
the overwrite type MMP card recording/reproducing 
apparatus. In this recording/reproducing apparatus 
878, the arrangement of an MMP card is different 
from that of the MMP card 852 described above. 
More specifically, data is directly printed on the 
base of the MMP card 852 itself. As shown in FIG. 
96A, however, an MMP card 880 in this embodi- 
ment is designed such that a very thin sheet (film) 
884 on which a dot code is recorded is stuck to a 
card base 882 consisting of thick paper, a plastic 
material, or the like. That is, a thin film-like sheet 
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on which data Is recorded as Shown in RG. 96B is 
stuck to the blower surface of the card. 

In the recdrdihj^reprcducing apparatus 878 us- 
ing this an MMP card 880, data read by a dot oode 
detection section 856 is synthesized with data from 
a personal computer or the like in the same man- 
ner as cTtfscribSd above, and the r^urtartt data is 
input, as a code pattern, to a priming section 866. 
At this time, the printing sebtion 866 does hot print 
the dot pattern on the lower surf gee of the card but 
prints it on a code recording sheet 888 from a 
paper feed cartridge 886, and newly sticks the 
sheet to the card base 882. In tfnS case, as shown 
in FiQ. 95B, one of tftb surfaces of the code 
recording sheet 888, which te not a printing surface 
890 of the code recording thin sheet 884 on which 
a code is actually printed, Is ah adhesive surface 
892 on which a self-adh&sh/e such ad ah adhesive 
is coated, and a protective shSet 894 is put bn the 
adhesive surface 892. After a printing operation, 
the protective sheet 894 Is (seeled off by a peeling 
bar 896 and wound up 6y a ffrotective sheet wind- 
up reel B98. The adhesive surfaoe 892 of the code 
recording thin sheet 884, from which the protective 
^Sheet 894 has been peeled off, is exposed and 
^pressed against the card base 882 by a pressing 
'Holler section 900 to be stuck thereto. The card is 
x %feh discharged as a data-recorded card, 
^s^- In this cage, slnfce the code recording thin 
^^sfeheet 884 is a viry thto film-Jikemember, the Sheet 
•^may be stacked/stuck on this card base 882. How- 
ever, if sudi thth shdSts are stacked on each oth&r. 
'the thickness of the card increases to some exferft, 
even though they are thin sheets. For this reason, 
an old code-pattern-recorded thin sheet peeling 
section 902 Is arranged midday along a card con- 
veyance path extending from the dot cod§ detec- 
tion Section 856 to the pressing roller section 900 
to peel off an old code-recorded sheet Tfits peeled 
old code-recorded sheet may be directly dis- 
charged or shredded by a shredder. 

Ah additional information addition section 904 
in FIG. 95 serves to add, for example, time in- 
formation indicating a specific time at Which data is 
recorded on ah original card by thii feSbrd- 
ing/reproducing apparatus 878, or information Iden- 
tifying a spebific terminal ifrheh tffe tec&rd- 
ing/reproducing apparatus 878 IS used as a teVmi- 
nal cdnn&t&d to a se&ic* <$fiter. Wrtft thfe in- 
form atioh. tlte us^ed i^bbrding/reprbdudng appara- 
tus 878 can be identified, or the interval betWeen 
recording operations can be known. 

FIQ. 97 shows still ajtottfeV arVangemdnl of trte 
overwHte type MMP ca% recording/reproducing 
apparatus. This recording/reproclucirtg apparatus 
906 is basically fife game as the rttfidrd- 
ing/reprodudng apparatus ^ffo wn in Ff6. 92. 
The recording/reproducing apparatus 906 paints 


out a recording surface Hi white instead of black to 
obtain a new printing surface. For this purpose, a 
white paint-out ink cartridge 906 arid a white paint- 
out Ink roUer -$W are arranged aftpr a dot code 
s detection section 

Wttf this arrangement since the lower surface 
of an MfcAP card is $&Wted In whfte, new tfata Is 
pNtlted on th6 surface &y a printing section 866. 
Although a paper fe6d cartridge 868 is arranged to 

io issue a new card, 4his component rfc6y be omltte^. 

A direct-read-arter*write type MMP card re- 
cording/reprcqucihg apparatus will ti^ described 
next. The dlr^-r^-aftef-wflte type apparatus is 
an apparatus for Additionally Writing riew informa- 

15 tion without erasing old informatibh as teng as a 
non-recorded area ^xtsts- in this case, all reproduc- 
tion pfocfcsfcifig of a dot code need hot b^ per- 
formed except for a case v/hefelrt <lata reproduc- 
tion from a ca& 4s td Be pd&ftttmd, i.e., in a 

20 recording operation, unlike the ai&ve overwrite 
type apparatus. 

FIG. 98A shows the arrangement of a direct- 
read^-after-wrfte typ£ fcard record- 

ing/reproducing apparatus 912. In a recording op- 

25 eratidn, a daWb6de^ 858 repro- 

duces only the marker information arid address 
information of tvyQ-dimensiortal blS&s, and a 66tie 
pattern generation seeition 864 generates bibck ad- 
d'resses cdnre'sporldihg to a portion to be subjected 

30 to dire<^-f^ao^atterH^ffte prdce&sin§. A dsfta-ipecord- 
ed area detection Section 914 defects a data-re- 
corded area of the caret A printing efeotidh 866 
prints a pattern frohi tH8* code pattern generation 
section 864 dfi a non<e&>riJeft atea (tft&cftead- 

35 after-iSHfe area) bf c&tff oh the basis of We 
ihforpfiatidn from the data-recorded area detection 
section 814. 

A3 shown in RG. 888, toe data-re conned area 
detection setrton 014 is constituted by a data- 

40 recorded area det$£tit>n section $16, a marker <re- 
tectidn Sectidn 9f8i a lagt portion manVer coordf- 
nate caT<5uJatf6ri eectfdn 020, and a direct-read- 
after-wfte steit edordTriSte 6utput section 0i22. That 
is, since tft$ si2& of a market and a Blobk are 

45 kHbwri, fire range of a datlNfeebrded ar¥a irt tfte 
codfer recdrdin$ atoa cart be dlftSfriaticaliy ^tect^d 
by the dataVi^^ ar^a d^t^^ eeoferiv Sffi 
and tfie rtWtrfatt detection s&mh 9lk TfWreford, 
dired-read^aft^wrfte start codrtlinafes are dalcu- 

50 lated by Uifr laSt pprtion rtiafkfr eodhfmate carcula- 
tion sectidh 920, fcrid the ^SUttan! dafe ftdfput 
from the dimct-read-itfteT-wrlte start cSibrtl&iate out- 
put see&rfft 823: 

Thd dgta-reoorded area detection sedtion 914 

55 may have an atrar^meKt like the drre $hown In 
FiQ. §9. In thte Ca^e, however, as ^hown in Fl6. 
100, reoofd r^t^ S24 Indicating th6 r^e of a 
data^^cord^f firi&a rftust be 1 recorded oh a mar- 
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ginal portion of a card. 

In the data-recorded area detection section 914 
detects, these record markers are detected by a 
recorded marker detection section 926, the range 
of a data-recorded area is calculated by a last 5 
portion recorded marker coordinate calculation sec- 
tion 928, and direct-read-after-write start coordi- 
nates are output from the direct-read-after-write 
start coordinate output section 922. That is, a small 
dot code marker need not be detected, but the 10 
larger record markers 924 are detected to facilitate 
a detecting operation. 

Note that these record markers 924 can be 
used to perform positioning in the printing section 
866. More specifically, in the previous case, posi- is 
tioning in the -printing section 866 demands a dot 
code read operation as well, but positioning can be 
performed by using only the record markers 924. 
That is. with -detection of the record markers 924, 
data may be recorded with a space of about 1 mm 20 
being ensured between a data-recorded area and a 
direct-read-after-write portion, or may be recorded 
with an offset of about 1 mm in the vertical direc- 
tion in FIG. 100. Therefore, a direct-read-after-write 
operation can be very easily performed. The block 25 
address of a data-recorded block may be read 
depending on the contents subjected to direct- 
read-after-write processing. With this operation, by 
adding a block address next to the last block 
address to a direct-read-after-write portion, the 30 
block address of the portion can be made to have 
continuity as one code. 

FIG. 101 shows a name card read system as 
an application using the above overwrite type or 
direct-read-after-write type MMP card. In this sys- 35 
tern, a MMP name card 930 on which multimedia 
information is written as a dot code is read by a 
MMP name card reader 932, an image is displayed 
on a CRT 938 of a personal computer or the like 
936, and speech is generated by a loudspeaker 40 
938. The MMP name card reader 932 is the same 
as the above information reproducing apparatus 
especially in terms of arrangement However, this 
apparatus is formed as a stationary type apparatus 
rather than a pen type apparatus because the 45 
apparatus is designed to read a name card. As is 
apparent, the MMP name card reader 932 may be 
provided in the form of a pen type information 
reproducing apparatus and a c?td type adaptor, as 
described above, and display and reproducing op- 50 
orations may be performed by an electronic note- 
book or the like. 

As in the case of the above overwrite or direct- 
read-after-write type MMP card, a dot code may be 
printed on the lower surface of an MMP name card 55 
930 having an upper surface on which a company 
name, a section to which the user belongs, a name, 
an address, and a telephone number are written, as 


shown in FIG. 102A. If English letters are written on 
the lower surface of a card as well, a dot code may 
be recorded by stealth printing 940 using an in- 
frared luminescent ink or fluorescent ink, as shown 
in 102B. 

An MMP card formed by a semiconductor wa- 
fer etching scheme will be described next. This 
card is obtained by recording a minute dot pattern 
on a semiconductor wafer by using a semiconduc- 
tor etching technique. The reflectance of a wafer 
surface having undergone mirror finish is different 
from an etched pattern portion. With this contrast, 
the dot code can be read. In order to increase the 
contrast and the S/N ratio, a member such as 
aluminum which greatly differs in reflectance or 
color from the wafer surface may be embedded in 
the etched dot code pattern. 

FIGS. 103A and 103B and FIGS. 104A to 104C 
show the arrangement of this card. A wafer 942 on 
which a dot code pattern is recorded is embedded 
in a base 946 of a card body 944. In this case, 
since the dot code pattern is recorded with a dot 
size at the several urn or sub-um level, recording 
can be performed at a very high density. There- 
fore, a ROM card of a gigabyte level can be 
realized. 

In addition, this card need not perform a nor- 
mal operation electrically, unlike a ROM-IC. For this 
reason, even if part of a pattern is defective, error 
correction processing can be performed in a re- 
producing apparatus. Therefore, the yield of the 
card is much higher than that of the ROM-IC. In 
addition, the number of steps for the card is much 
smaller than that for the IC, the card can be sup- 
plied at a very low cost. 

However, the dot code pattern is formed at a 
very small pitch, careful consideration must be 
given to dust, fingerprints, and the like. For exam- 
ple, in order to protect the dot code pattern, a 
plurality of slide type protective covers 948 are 
attached to the wafer 942 surface of the card body 
944, as shown in FIGS. 103A and 103B, or a single 
protective shutter 950 is attached to the surface, as 
shown in FIGS. 104A to 104C. 

In this case, the number of protective covers 
948 is four. These covers can be selectively 
opened in several ways. For example, only a nec- 
essary cover may be opened, or the covers may 
be opened in the. manner of opening sliding doors. 
When the card is to be inserted, all the covers may 
be slid to one side. 

The protective shutter 950 is designed such 
that it is entirely opened when the card is inserted, 
and is closed when the card is removed. For exam- 
ple, as shown in FIGS. 104B and 104C, the wafer 
portion 942 is put on the base 946, and grooves 
952 are formed in both sides of the base 946. The 
protective shutter 950 is fitted in the grooves. A 
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stopper 956 is formed On the distal end of a pawl 
portion 954 on a side surface of the protective 
shutter 950. On the cord base 946 sttie which 
receives the protective shutter 950, the depth of 
each groove 952 decreases to Stop the stopper 
956 to stop at a predfctenrilrt&d position, tfiereby 
preventing the protective shutter 950 from belhg 
opened beyond a predetermined position. 

When a dot code is to be reproduced from 
such an MMP card formed by the semiconductor 
wafer etching scheme, "tf pen ty^e information re- 
producing apparatus lik© the one described above 
may be used* In this case, however, an image 
formation optical system of the microscope level 
rfiust be used. Alternatively, ah Image formation 
optical system may be mechanically moVed in the 
form of a line sensor. 

FIG. 105 shows a disk apparatus 958 with a dot 
code decoding function. More specifically, a dot 
code reproducing function and a recording function 
are newly added to a known disk apparatus for 
recording/reproducing audio fnforrhation suCh as 
music information on a maQnetooptical disk, hi this 
apparatus, a dot code on a sheet 960 Uk& the one 
Shown in FIG. 106 is scanned by using ah operat- 
frifg section 962 to reproduce a code, and the code 
Is output to an information device 964 such as a 
-^rsonaJ computer or an electronic notebook or an 
Carphone 966. 

^* As shown iii FIQ. 107, according to a known 
: ifrangement, the disk apparatus 958 inoludes a 
^Indle motor 968, ah optical pickup 970, a 
grooves 972, a head driving drctift 974, an address 
c&boder 976, ah RF amplifier 978, a servo control 
cirfcuH 980, an EFM (Eight to FburteSn Modulation)* 
/AGtftC (Advanced Cross Interleave Read ScHdmon 
Code) circuit 982, a memory controller 984 for anti- 
vibration, a memory 986, a display section 986, a 
key operation panel 990, a system controller 99?. a 
compression/decompression processing section 
994, an A/D converter 996, an audio input terminal 
998, a D/A converter 1000, and an audio output 
terminal 1002. 

In this case, the EFM/ACIRC cifcuit 982 is a 
section for performing encoding arid decoding op- 
erations in disk write and read operations. The 
memory controller 684 for anti-^bratioh interpolates 
data by using die memory SS& tb prevent sound 
omission caused by vibrations. The compres- 
sion/decompression processing section 994 per- 
forms compression/decompression processfng by 
using an audio efficient dodihg scheme* called AT- 
RAC (Adaptive Transform Actt&tic Coding) as one 
type of transform coding scheme of performing a 
coding operation by conversion from the time axis 
to the frequency axis. 

The disk apparatus 958 with the dot code de- 
coding function of thts embodiment is obtained by 


adding an image processing section 1004 for re- 
ceiving an image signal from the operating section 
962 and performing processing like thb one per- 
formed by the lmag$ processing section 460 In 
s FIQ. 55, a connection terminal 1006 and an t/F 
1008 for the ibfdrfriatlQn device 664. Irt addition, 
since the compression/decompression processing 
section 994 is constituted by an ASf&DSP and ihe 
like, the function of the data processing section 462 
70 for performing demodulation and error correction 
for reproduction of the above dot code and pro- 
cessing for data compression/decompression for 
Other information devices 10GB are Incorporated in 
the compression/decompression processing see- 
rs tion 994. 

Note that the qperating section 962 includes an 
optical system 1010, an image pickup ef&m§nt 
1012, and an amplifier 1014 corresponding to, for 
example, the image forrrratioh optical system 200, 
20 thfei irn&ge pickup section 204, arid the preamplifier 
206 In FIG. 55, respectively. 

In an information reproducing apparatus for re- 
producing a dot code, a large-capacity memory is 
generally required to reproduce large-capacfty in- 
25 formation such as music information. If, however, 
the apparatus has a recording/reproducing serition 
for a disk 1016; such a large-capacfty merriory cah 
be omitted. In addition, the sound reproducing Sec- 
tion, i.e., the sound compression/decompression 
30 processing section 994, the 0/A cdnverter 1000, 
and the like in this case, can be commohly us£d. 
Furthermore, if ' the speech compres- 
sion/decompression processing section 694 is 
fohmed to also serve as a data processing section 
36 for code reproduction processing, and Is designed 
by using an ASIC-DSP, a tow-cost, compact ap- 
paratus can be realised. 

The disk apparatus 958 with tfie dot code de- 
coding function. Which has thfe 6bove arrangement, 
40 can serve as a general, disk apparatus for record- 
ing/reproducing souhd, performing selection of rhu- 
sic, and the like, and can also be uSSd as a ddt 
code reproducing apparatus, this function switch- 
ing operation is performed by tKe operctfion of the 
45 key operation panel 690 under the control of the 
system controller 992. 

When the disk afrr3aratus 956 \k to be used as 
a dot code reproducing apparatus, the following 
methods for use are assumed. As shown fn FIG. 
so 106, music pLefee sdlectibn ihdSxes, dfcch cx/nsist- 
ing of a music pfiece nifofe and a singer rtarhe, ar§ 
written in character, and dot codes corresponding 
to the respective mu^fc fS&ces are recorded, in this 
case, since each music piece is rnforrrtation on the 
55 ord§r of, e.g., three or four minutes, each Informa- 
tion is considerably Idhg. For this feasori, each ddt 
code is divided arid recorded on a plurality of fines, 
four in FIQ. 106. That is, each music piece is 
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divided into dot codes of a plurality of lines and 
recorded on a sheet while block addresses indicat- 
ing the positions of blocks in the music piece are 
added to each dot code, assuming that a block 
whose X and Y addressee are "1" and "1 respec- 6 
tively, is regarded as a header block. In a re- 
producing operation, all the dot codes on the plu- 
rality of lines are scanned, and the resultant data is 
recorded on the disk 1016. 

At this time, even if scanning is performed at to 
random, the music piece can be written on the disk 
1016 in consideration of recording positions based 
on addresses indicating the positions of blocks in 
the music piece, i.e., can be recorded in a correct 
order. Assume that one music piece is divided into 75 
dot codes on-lour lines, as shown in FIG. 106, and 
the dot code on the second line is scanned first by 
the operating section 962. Even in this case, since 
the ordinal number of the scanned dot code, i.e., 
that the dot code is the second dot code, is known 20 
from the address, the dot code can be recorded 
with a recording portion for the first dot code being 
ensured. Therefore, when audio information repro- 
duced from dot codes is recorded on the simple 
printer system 106, the information can be repro- 25 
duced in a correct order. 

.In addition, the u?er can form an original cjisk 
on which, for example, music pieces A and C are 
recorded first, and then a music piece D is re- 
corded, without using another audio reproducing 30 
apparatus, e.g., a tape cteck or a CD reproducing 
apparatus. Assume that the user scans the dot 
codes of a plurality of music pieces recorded on 
the sheet 960 in the order of reproduction to be 
performed in a reproducing operation while seeing 35 
the music selection indexes. In this case, for exam- 
ple, the music pieces can be recorded in the order 
of A, C. D, ..~ lf the music pieces are reproduced 
in the normal mode, they are reproduced in the 
order named. That is, programming can be per- 40 
formed. 

Note that as the information device 964, an 
image output apparatus can be used. For example, 
an FMD is used, and JPEG and MPEG like those 
disclosed in Japanese Patent Application No. 4- 45 
81673 are performed by the compres- 
sion/decompression processing section 994, to- 
gether with three-dimensional image decompres- 
sion processing. The resultant data is converted 
into a video signal by the i/F 1008. With this so 
operation, a three-dimensional image correspond- 
ing to the read dot code can be displayed. As 
described above, this embodiment is not limited to 
audio information either. 

In addition, as is apparent, this embodiment 55 
can be applied to other digital record- 
ing/reproducing apparatus such as a DAT. 


A case wherein a dot code recording function 
is incorporated in a silver chloride camera. 

FIGS. 108A and 108B show the arrangement of 
a rear cover 1018 of a cjamera capable of recording 
a multimedia information dot code. In this arrange- 
ment, a two-dimensional LED array 1022 for re- 
cording a dot code is Arranged beside a member 
like a conventional data back for recording date 
information such as year, month, and day informa- 
tion by using an LED array 1020. A circuit incor- 
porating section 1024 is arranged behind the data 
back. A circuit for ON/OFF-controlling the LED ar- 
ray 1020 and the like are incorporated in this 
section. In addition, a circuit system for recording a 
multimedia information dot code is incorporated in 
the section to print data, as a dot code, on a silver 
chloride film (not shown) by using the LED array 
1022. For example, a stickpin type microphone 
1026 is connected to the circuit incorporating sec- 
tion 1024. Speech is picked up from the micro- 
phone 1026 and the corresponding information is 
exposed, as a dot code, on the film by using the 
LED array 1022. 

In addition to the LED arrays 1020 and 1022, 
an electrical contact 1028 for the camera body side 
is prepared for the data back 1018 because control 
is performed by using a CPU and the like of the 
camera tody. Furthermore, a pawl portion 1032 of 
a hinge portion 1030 can be slid so that the data 
back 1018 can be detached from the camera body 
by using a pawl portion slide lever portion 1034. 
That is, this data back 1018 can be replaced with 
the rear cover of the camera body. 

This embodiment exemplifies the apparatus for 
recording a dot code at once by using the two- 
dimensional LED array 1022. In contrast to this, 
FIG. 109A shows an apparatus for recording a dot 
code two-dimensionally by moving a dot code re- 
cording LED unit 1036. As shown in FIG. 109B, this 
dot code recording LED unit 1036 is constituted by 
a linear LED array 1038 and a lens 1040 for focus- 
ing, e.g., reducing, light from the LED array 1038. 
Electrical signal electrodes 1042 for receiving sig- 
nals for controlling the LED array 1038 extend from 
both sides thereof. The electrical signal electrodes 
1042 are brought into slidable contact with a signal 
electrode plate 1044 on the data back 1018 side, 
which is shown in FIG. 109C, upon movement of 
the dot code recording LED unit 1036. The elec- 
trical signal electrodes 1042 receive data signals 
from the signal electrode plate 1044. Note that a 
scan window 1048 consisting of, e.g., a transparent 
glass or acrylic material is formed on a film press 
plate 1046 of the data back 1018, and only the dot 
code recording LED unit 1036 opposes a film (not 
shown). 

When a two-dimensional LED array is to be 
used, necessary portions may be electrically 
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turned on without physically moving the array. 
When, however, this one-dimensional LED array 
1038 is to be used, the dot code recording LED 
unit 1036 must be moved. As a moving mechanism 
for thte untt, a mechanism Hke the one shown in 5 
FIG. 109© is conceivably. More specifically, the 
arrangement of thte mechanism is ba&ft&lfy the 
same as that of a w#ii knowh moving mechanism 
for the needle of a tDner. When pulleys 1052 are 
rotated by a motor 1050. the dot ecde recording 10 
LED unit 1036 having two end fixed to Wire lines 
10S4 wound around the pulleys 1052 is moved 
laterally. Since the wire lines 1054 do not de- 
compress/contract, the dot code recording LED unit 
1036 can be moved with high predston. In addition, is 
in order to accurately translate the dot code record- 
ing LED unit 1036, the pulleys 1052 and the wire 
finbs 1054 are arranged on both sides of the dot 
code recording LED unit 1036. 

In addition, as a moving mechanism for the dot 20 
code recording LED unit 1036, an uitrasoriic mdtor 
1056 can be used. Ss fcJibwn in RG. 1S9E. The 
ultrasonic motor 1056 applies vibrations to a vibra- 
tion plate 1058 for transferring ultrasonic wave mo- 
tSftn as if w£ves Were moved to right and left. A 25 
ri&vdble member 1000 is then moved to right arid 
feUras if to ride on the waves. Upon movement of 

movable merfiber 1060, the dot code recording 
vfigo uhTt 1036 connected thereto is also moved to 
4i§ht and left 30 
4VFIQ. 110 shows the circuit arrangement of the 
c©a back 1018 shown fn FIGS. 108A atfd TQ9A. 
Especially the portion ehdos^d wfth the broken line 
Indicates <fie arrangement of the data back 1016. 

A CPU (e.g., a one-chip microcomputer) 1X)62 35 
arranged fn the camera body controls the overall 
cdmera. An exposure control Action 1064 per- 
forms exposure control on the basis of photometric 
dafa from a photometric section 1066. The expo- 
sure control section 1064 controls a shutter speed 40 
or dh aperture or both through a shutter control 
section 1068 and an aperture control section 1070 
depending tih a purpose or a mode, thereby per- 
forming optimal exposure. I 

the CPU 1062 calculates a lens control 45 
amount by using lerts information held bh the Idhs 
or camera body side, and causes a tens coi%bl 
secfldft 1074 to perforrh ne^Sssary lens control. 
This cbfttrbl includes focus edritfol aihd zdbm con- 
trol. In addition, the CPU 1062 controls a shutter so 
operation in accordance with the operations of a 
focus lock button 1078 end a release button 1078 
(in general, one button mechanically serves as the 
two buttons, end si£n£ts are independently output 
therefrom). The CPU 1062 causes a rfiSfor cdnirol 55 
section 1080 to control a motor 1082 for winding 
up a film. 


In addition, the CPU 1062 can exchange data 
with k multimedia information record- 
ing/reproducing section tQ84, a multimedia infor- 
mation L^O controller 1086, and a date LEO con- 
troller 1088 Via the electrical contact 1028 for the 
camera bo«iy side. The date, LED controller 1088 
Cofitfbls ernissfaji & &date LED array 1020 to print 
a portography datd and time on a film. The data 
back 1018 ioeorpprates a date clock generator 
1090 for generating a time pattern for this printing 
operation. 

In the multimedia information record- 
ing/reproducing sectlbti 1084, the recording system 
includes, for etfarrfple, <$mponents ranging frbm a 
compofi^nt for inpiifting speecli to a component 
immediately before l e component for code synthe- 
sis/edit processing in the arrangement shown in 
FIG. IS, I.e., up to a cdmpondnt for generating a 
pattern, whereas the reprdducing system includes, 
for example, components ranging frbm the scan 
conversion section 1 86 to the D/A conversion sec- 
tion 266 in Fl<5. f7. The multimedia information 
LED contrdilSr iUSS controls emission of the LED 
arrays 1022 or 1038 in accordance with a dot code 
pattern output from the multimedia information re- 
cording/reproducing section 1084. In the case 
shdwn in FlS. 108A, the USD array 1022 is u^d, 
the dot bbde pattern can be exposed with only this 
arrangement Ih cbntrast to ihisj ih the case shown 
in FIG. 109A, slhcfe trtb LED array 1038 must be 
moved, the motor 1050 is driven by the LED array 
moving rnbtor controller 1092 to move the dot code 
recbfcfirig LE©* unit 10M The multimedia informa- 
tion LED controller 1086 sequentially supplies nec- 
essary code (riforrh&tion to be recorded at a given 
position to the USD array 1036 and causes it to 
emit fight in accordance with the timing of move- 
ment by tfie motor 10S0. 

Note tfmt a Various mode setting key 1094 is 
arranged on the camera body Side. This key is 
constituted by several buttons. Alternatively, a 
mode switching buttbh, a setting button, and the 
like may be sppafat&ly arranged. In addition, the 
toy m&y be t^n0tt oh the data bade side. In this 
case, a 1&y dparatfoft $igmfl ^applied to W6 CPU 
1062 via the elScfricSl contact. 

In the above arrkigerh&rlt, for example, a dot 
code is fexpo^ed onto e film fn the following man- 
ner. WrWfi an Ojaer^tidh signal from the focus lock 
1076 button, whictf is an Indicator of tile start of a 
prwtogr^hlc operation, is activated, the CPU 1062 
loads speech from the rftcrdphone 1026 into the 
multimedia irtfdmtetibh reobrdlng/reproducing sec- 
tion 1084. and causes a storage section (not 
sftofttf) in tiie ttuMmedia Irtermation record- 
ingA-eproducIng section 1084 to sequentially $tofe 
speech d£t£ cdrresffcndlrifl to a prddeternHined (5e- 
ribd of tirfte. Fbr eo&mpiia, this prrMetermined pe- 
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riod of time is set to be, e.g., five or ten seconds in 
advance, and the maximum capacity of a memory 
(not shown) is set in accordance with the predeter- 
mined period of second. Speech data is then se- 
quentially and cyclically stored in the memory, 
similar to a general voice recorder. When the re- 
lease button 1078 is depressed, the CPU 1062 
causes the multimedia information record- 
ing/reproducing section 1084 to convert speech 
some seconds (e.g., five seconds) before the de- 
pression of the button or before and after (e.g., one 
second after and three seconds before). the depres- 
sion of the button into a dot code. This setting can 
be performed by the user through the mode setting 
key 1094. The speech stored in the multimedia 
information recording/reproducing section 1084 is 
actually converted into a code. The code is printed 
on a film by the LED arrays 1022 or 1038. After 
this operation, 4he CPU 1062 performs a film wind- 
up operation. As is apparent, the LED array moving 
motor controller 1092 and the film wind-up motor 
control section 1080 may be properly synchronized 
with each other so that a recording operation can 
be performed while the film is wound up upon 
matching of the speed and timing of movement. In 
this case, the apparatus can properly cope with 
high-speed sequence shooting and the like. In ad- 
dition, the dot code recording LED unit 1036 may 
be fixed, and a recording operation can be per- 
formed while a film wind-up operation is performed. 
In this case, one motor can be omitted. 

As is apparent, in addition to recording of 
speech as dot code information on a film, various 
information on the camera side, which js supplied 
from the CPU 1062, e.g., information indicating the 
type of a lens currently used, a shutter speed, and 
an aperture, can be recorded. That is, for example, 
specific conditions in which a photographic opera- 
tion is performed can be known after a photograph 
is completed. In general, such information is to be 
retained in user's memory. With the arrangement 
of this embodiment, by reproducing a dot code on 
a film or photographic paper on which the film is 
printed through the multimedia information dot 
code reproducing apparatus, the information can 
be selectively displayed, and the user can know 
conditions and the like set in the camera in a 
photographic operation. When, for example, the 
user wants to take a picture in the same conditions 
as those previously set, the same conditions can 
be easily set Especially when pictures are to be 
routinely taken, e.g., changes in specific scenery 
are to be taken monthly, such a camera is very 
useful. 

FIG. 111 shows a case wherein a film on which 
a dot code is printed is subjected to photoprinting. 
In this case, for example, a dot code 1096 arid a 
date code 1098 written on a film are subjected, as 


pictures, to photoprinting, together with the other 
picture portion 1100. In this case, sound informa- 
tion or various camera information can be repro- 
duced by scanning the dot code 1096 with the 
s above multimedia information dot code reproducing 
apparatus. If, for example, only a dot code is ex- 
tracted and printed on the lower surface of a photo- 
graphic paper on the DPE side, only a photograph 
is printed on the upper surface of the card to 
70 obtain a photograph similar to a conventional pho- 
tograph. In addition, if trimming information in the 
DPE such as zooming/panoramic mode switching 
information is recorded, as one piece of camera 
information, on a film; the DPE can perform 
is photoprinting in the panoramic or zooming mode 
by scanning the dot code on the film and reading 
the information. 

When a dot code is printed on a film, double 
exposure is performed together with an actual 
20 scene. In this case, if strong external light is in- 
cident, the dot code may not be properly printed. 
For this reason, for example, in some conventional 
camera capable of coping with the panoramic 
mode, when the panoramic mode is set, a light- 
25 shielding plate is inserted vertically to prevent a 
scene from being printed on the shielded portion. A 
similar function may be employed. More specifi- 
cally, a light-shielding plate may be automatically 
inserted, or the light-shielding plate may be fitted in 
30 a portion in front of a film and behind the lens if the 
camera is designed to print a dot code. In addition, 
a code may be recorded on a marginal portion 
(portion free from exposure) of a film. 

Referring, to FIG. 110, a pen type information 
35 reproducing apparatus 1102 may be connected to 
the data back 1018 to display camera information, 
i.e., aperture information, shutter information, lens 
information, and the like on, e.g., an LCD mode 
display section 1104 incorporated in the rear side 
40 of the camera back or the camera body or an LED 
display section 1106 in the finder. In addition, a 
mode may be set in the same conditions as those 
read from the dot code 1096 by scanning it. That 
is, when the dot code on a film or a photograph is 
45 scanned, the respective conditions on the camera 
side are automatically set in accordance with the 
corresponding mode. As a result, the same shutter 
speed, the same aperture, and the same magnifica- 
tion of the lens as those read from the dot code are 
so set. 

As has been described in detail above, accord- 
ing to the present invention, there is provided a dot 
code which allows low-cost, large-capacity record- 
ing of multimedia information including audio in- 
55 formation and digital code data and can be repeat- 
edly reproduced, and an information record- 
ing/reproducing system capable of record- 
ing/reproducing the dot code. 
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Claims 

1. An information recording system characterized 
by comprising 

input means for inputting multimedia in- 
formation including at fe&st one of audio in- 
formation, video information, and digital code 
data; 

conversion means for converting multi* 
media information from said input means into a 
dot code which can be optically read; and 

recording rhfeans for recording the dot 
code converted by said conversion means on 
a recording medium such that the dot code 
caii be optically read. 

2. A dot code characterized by comprising a plu- 
rality of blocks, 

each of Said blocks including a data dot 
pattern obtained by arranging a plurality of 
dots in accordance with contents of data, a 
marker having a pattern which cannot be iden- 
tical to said data dot pattern and arranged to 
have a first predetermined positional relation- 
ship with respect to said data dot pattern, a 
block address pattern indicating an address of 
said block arranged to have a second pre- 
determined positional relationship with respect 
to said marker, and an error detection code 
pattern arranged for the block address to have 
a third predetermined positional relationship 
with respect to said block address pattern. 

3. An information reproducing system character- 
ized by comprising 

read means for optically reading a dot 
code from a recording medium having a por- 
tion on which multimedia information Including 
at least one of audio information, video in- 
formation, and digital Sode d£ta is recorded as 
the dot code which can be optically read; 

restoring means., for converting the dot 
code read by said read means into the original 
multimedia information; and 

output means for outputting the multimedia 
information restored by said restoring means. 

4. An information reproducing system according 
to claim 3, characterized in that 

the dot code comprises a plurality of 
blocks, each of the blocks includes a data dot 
pattern obtained by arranging a plurality of 
dots in accordance with contents of data, a 
marker having a pattern which cannot be iden- 
tical to the data dot pattern and Arranged to 
have a first predetermined positional relation- 
ship with respect to the data dot pattern, a 
block address pattern indicating an address of 


the block arranged to have a second predeter- 
mined positions! relationship with resect to 
the marker, &td an error detection code pat- 
tern arranged for the block address to have a 
s third predetermined positional relationship with 

respect to the block address pattern, and 

edid r^it$j md£ns includes 

first memory means for storing the dot 
code read by $S* read means, 
io marker detecting rneians for detecting a 

fn&ttcet of each block from the dot code stored 
in said first memory means, 

data array direction detecting means for 
defecting a data army direction from the mark- 
75 er of each block which Is detected by said 

marker defecting means, 

first address eontroF means for causing 
said first memory mentis to output the stored 
dot cede in accordance with the data array 
20 direction detected by said data array detecting 

means, 

demodulation means for demodulating the 
dot code output from said first memory means 
upon binarization, 

25 block address detecting means for detect- 

ing the block addresses from the demodulated 
output data from said demodulation means, 

second address control means for map- 
ping the demodulated output data from said 

30 demodulation means in said second memory 

means in accordance with the block addresses 
detected by said block address detecting 
means, and 

data output means for outputting the de- 

35 modulated output data mapped in said second 

memory means. 

5. An information reproducing system according 
to claim 3; characterized in that 

40 the dot code comprises a plurality of 

blocks, each of the blocks includes a data dot 
pattern obtained by arranging a plurality of 
dots in accordance with contents of data, a 
marker having a pattern which cannot be iden- 

45 tical to the data dot pattern and arra'riged to 

have a first predetermined positional relation- 
ship with respect to the data dot pattern, a 
block acidresS pattern indicating an address of 
the block arranged to have a second predeter- 

so mined positional relationship with respect to 

the marker, and an error detection code pat- 
tern arranged for the blo'ck address to have a 
third predetermined positional relationship with 
respect to the block ^jJdress pattern, and 

55 said restoring means Includes 

first memory m&ans for storing the dot 
code read by said re^q means, 

marker detecting means for detecting a 
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marker of each block from the dot code stored 
in said first memory means, 

data array direction detecting means for 
detecting a data array direction from the mark- 
er of each block which is detected by said 5 
marker detecting means. 

block address detecting means for detect- 
ing the block addresses in accordance with the 
data array direction detected by said- data ar- 
ray direction detecting means, 10 

demodulation means for demodulating the 
dot code output from said first memory means 
upon binarization, 

address control means for mapping the 
demodulated output data from said demodula- 75 
tion means in said second: -memory, means in 
accordance with the block addresses detected 
by said block address detecting means, and 

data output means for outputting the de- 
modulated output data output from said de- 20 
modulation means and mapped in said second 
memory means. 
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CALCULATE TEMPORARY CENTRAL PIXEL OF 
DETERMINED MARKER 
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CHECK PIXELS UPWARD (MINUS DIRECTION ON Y AXIS) 
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^f,t S n" P y Af l D ,N ™ E SAME MANNER AS DESCRIBED 

SSSSJff 7£ Y o A SP RESS AT WH,CH NO. BLACK PIXEL IS 
PRESENT, AND SET Y ADDRESS IN Y min 
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CHECK PIXELS DOWNWARD (PLUS DIRECTION ON Y AXIS) 
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5§SXfJT*2H I ADDRESS AT WHICH NO BLACK PIXEL IS 
PRESENT, AND SET Y ADDRESS IN Ymax 
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